Acknowledgements
Table 5.7: Child BLEU scores when trained with some parameters frozen. Each row represents a parameter set that was fixed at the pre-trained values of the Czech→English parent. Best result for frozen parts in each column in bold.
['Frozen part', 'EN→Estonian', 'Estonian→EN']
encoder for Estonian→EN) that handles the language that changes from the parent to child. With this part fixed, the performance drops the most. Freezing the encoder (resp. decoder for Estonian→EN) or attention is not that critical as a frozen decoder (resp. encoder). BiRNN Bidirectional Recurrent Neural Network BP Brevity Penalty BPE Byte Pair Encoding CNN Convolutional Neural Network IWSLT International Workshop on Spoken Language Translation LanideNN Language Identification by Neural Networks LM Language Model LSTM Long Short-Term Memory cells MT Machine Translation NLP Natural Language Processing NMT Neural Machine Translation NN Neural Network PBMT Phrase-Based Machine Translation POS Part-of-Speech OOV Out-of-Vocabulary RNN Recurrent Neural Network SMT Statistical Machine Translation T2T Tensor2tensor WAT Workshop on Asian Translation WMT Workshop on Statistical Machine Translation