Effective Parallel Corpus Mining using Bilingual Sentence Embeddings
Table 6: BLEU scores on WMT datasets of the NMT models trained on filtered ParaCrawl data.
['[EMPTY]', '[BOLD] en-fr', '[BOLD] en-es']
For this experiment, our confidence score is fine-tuned on the ParaCrawl corpus using an additional 900k positive and 900k negative examples selected based on having extreme Zipporah scores. With Zipporah, we select all examples from ParaCrawl with a Zipporah score greater than or equal to 0, which is the threshold used in the official release. There are 43 million such pairs in en-fr and 24 million in en-es. We then select the same number of pairs from the ParaCrawl data that have the highest scores from our fine-tuned model.