Acknowledgements
Table 4.9: Results of various warm-start transfer learning approaches. The first two columns show the performance of the parent model, the third and forth column is the child model based on the corresponding parent in the same row. The baseline does not use transfer learning and uses language-pair-specific vocabulary. Scores are in BLEU and are comparable only within columns.
['Method', 'Parent score EN→CS', 'Parent score CS→EN', 'Child score EN→Estonian', 'Child score Basque→EN']
All four transfer learning techniques outperform the baseline trained only on the child language pair, the gains of nearly 8 BLEU points for English→Estonian and 4 BLEU points improvement for Basque→English are significant. BiRNN Bidirectional Recurrent Neural Network BP Brevity Penalty BPE Byte Pair Encoding CNN Convolutional Neural Network IWSLT International Workshop on Spoken Language Translation LanideNN Language Identification by Neural Networks LM Language Model LSTM Long Short-Term Memory cells MT Machine Translation NLP Natural Language Processing NMT Neural Machine Translation NN Neural Network PBMT Phrase-Based Machine Translation POS Part-of-Speech OOV Out-of-Vocabulary RNN Recurrent Neural Network SMT Statistical Machine Translation T2T Tensor2tensor WAT Workshop on Asian Translation WMT Workshop on Statistical Machine Translation