Effective Parallel Corpus Mining using Bilingual Sentence Embeddings
Table 7: GOOD translation rate (%) annotated by translation professionals.
['[EMPTY]', 'en-fr', 'en-es']
The performance between the two approaches is close for en-es and the proposed score normalization model is 4% better for en-fr. In our analysis of the BAD translation pairs, one common failure pattern from the proposed model is that one of the sentences is only partially translated in the other sentence. This is likely because we are still missing enough of these types of hard negatives in the training data. We also find our model produces more pairs where the sentences on both sides are identical. These identical pairs are mostly labeled as BAD translations because they are unlikely to be actual translations.