Skip to content

Final project in NLP course, fine-tuning on T5-base and handling with hints in the test set.

Notifications You must be signed in to change notification settings

almog2065/Translate-German-to-English

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Translate-German-to-English

For the thask of Name-Entity recognition i used pre-trained T5-Base model. The data for training contains German sentence and English sentence. The test data without labels was German sentence with hints from the translated english sentence, such as roots and modifiers in the sentence. So for training the data to be accurate on the test data, i used a depedancy parsing model from spacy('en_core_web_sm') to extract the roots and modifiers from the training data. After this, i create training data with German sentence and hints and English sentence as label. On this dataset i trained the T5-Base. The evaluation function was BLEU that stands for translate tasks.

About

Final project in NLP course, fine-tuning on T5-base and handling with hints in the test set.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published