Baselines and Test Data for Cross-Lingual Inference
Table 3: F1 scores for contradiction, entailment, and neutral for our best system, random.
['[EMPTY]', '[BOLD] con', '[BOLD] ent', '[BOLD] neu']
The mapping to English works slightly better for Arabic than for the other languages, and scores an average of 52%. The random bilingual embeddings top their group with an average accuracy of 59.6% followed by invert at 58.1%, while ratio and bicvm are below at 56.1 and 57.4%. The MT approach expectedly tops the table at 75.5% accuracy. This also holds true for the original \newciteparikh2016decomposable evaluation on English.