Merged

Feature/encoder#7
inmoonlight merged 22 commits intomasterfrom feature/encoder

Feature/encoder#7

Merged

inmoonlight merged 22 commits intomasterfrom feature/encoder

Oct 17, 2020

+36,914-367

Commits on Sep 12, 2020

feat: add transformer base and big configs
inmoonlight
committedSep 12, 2020
chore: add todo
inmoonlight
committedSep 12, 2020

Commits on Sep 16, 2020

feat: remove template script
inmoonlight
committedSep 16, 2020
feat: split model into transformer-base and big
inmoonlight
committedSep 16, 2020
feat: add mask when prepare encoded tokens
inmoonlight
committedSep 16, 2020
feat: add encoder
inmoonlight
committedSep 16, 2020
style: apply isort and black
inmoonlight
committedSep 16, 2020

Commits on Sep 18, 2020

chore: update model configs
inmoonlight
committedSep 18, 2020
fix: bugs related to config
inmoonlight
committedSep 18, 2020
fix: bugs related to dataset
inmoonlight
committedSep 18, 2020

Commits on Oct 2, 2020

refactor: rename and reorganize directory
inmoonlight
committedOct 2, 2020
fix: fix typo and save directory
inmoonlight
committedOct 2, 2020
feat & refactor: batch by token nums and split dataset and dataloader
inmoonlight
committedOct 2, 2020
fix: fix bug
inmoonlight
committedOct 2, 2020
test: update test
inmoonlight
committedOct 2, 2020
style: apply isort and black
inmoonlight
committedOct 2, 2020

Commits on Oct 5, 2020

chore: modify get_configs and get_config module to the builder
inmoonlight
committedOct 5, 2020
fix: fix attention module to support masked attention
inmoonlight
committedOct 5, 2020

Commits on Oct 6, 2020

chore: add example tokenizer
inmoonlight
committedOct 6, 2020
refactor: update encoder
inmoonlight
committedOct 6, 2020
style: apply isort and black
inmoonlight
committedOct 6, 2020
chore: add type hinting
inmoonlight
committedOct 6, 2020