Learning variable length units for SMT between related languages via Byte Pair Encoding
(b) LeBLEU scores
['[BOLD] Pair', '[BOLD] C', '[BOLD] W', '[BOLD] M', '[BOLD] O', '[BOLD] B [ITALIC] match']
Since we are concerned with low resource scenarios, a desirable property of subword units is robustness of the translation models to change of translation domain. Since BPE units are learnt from a specific corpus, it is not guaranteed that they would also be robust to domain changes. In this cross-domain translation scenario, the BPE level model outperforms the OS-level and word-level models for most language pairs. The Konkani-Marathi pair alone shows a degradation using the OS level model. The BPE model is almost on par with the OS level model for Telugu-Malayalam and Hindi-Malayalam.