Acknowledgements
Table 5.14: Performance and average number of words generated over the testset. The references have average number of words 15.6 for the Czech testset 15.4 for the Estonian testset.
['Sentence lengths', 'Parent BLEU', 'Parent Avg. words', 'Child BLEU', 'Child Avg. words']
We start by discussing the parent performance. The parent model is unable to generalize from training data of different length for the training set. Although it generates sentences with slightly better length ratios than the training set, however, it cannot generalize the sentence length well. For example, when training on “1-10 words” it produces testset sentences with an average length of 10.9, which is more than it saw during the training. Similarly, “40-60 words” generates sentences of an average length of 35.5, which is shorter than training sentences. BiRNN Bidirectional Recurrent Neural Network BP Brevity Penalty BPE Byte Pair Encoding CNN Convolutional Neural Network IWSLT International Workshop on Spoken Language Translation LanideNN Language Identification by Neural Networks LM Language Model LSTM Long Short-Term Memory cells MT Machine Translation NLP Natural Language Processing NMT Neural Machine Translation NN Neural Network PBMT Phrase-Based Machine Translation POS Part-of-Speech OOV Out-of-Vocabulary RNN Recurrent Neural Network SMT Statistical Machine Translation T2T Tensor2tensor WAT Workshop on Asian Translation WMT Workshop on Statistical Machine Translation