Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmax
Table 6: The final F1 scores of BUCC shared task with rescoring. Baseline 1: best results from [Zweigenbaum et al.2018]. Baseline 2: [Artetxe and Schwenk2018] with margin based scorer.
['[EMPTY]', 'Model', 'fr-en', 'de-en', 'ru-en', 'zh-en']
Margin-based rescoring still helps to improve the F1 scores 2 to 3 points on average, even using the simplified one-directional version from Eq. The BERT rescoring model significantly outperforms the current state-of-the-art models, with F-scores ranging from 93.38 (ru-en) to 97.24 (de-en).