El Departamento de Nosotros: How Machine Translated Corpora Affects Language Models in MRC Tasks
Table 2: Performance on es-SQuAD. All models are in the case-sensitive mode. Best column results in bold, second best underlined.
['Model', 'es-SQuAD (TAR) 1.1', 'es-SQuAD (TAR) 1.1', 'es-SQuAD (TAR) 1.1', 'es-SQuAD (TAR) 1.1', 'es-SQuAD (TAR) 2.0', 'es-SQuAD (TAR) 2.0', 'es-SQuAD (TAR) 2.0', 'es-SQuAD (TAR) 2.0', 'es-SQuAD (MT) 1.1', 'es-SQuAD (MT) 1.1', 'es-SQuAD (MT) 2.0', 'es-SQuAD (MT) 2.0']
In the first experiment, we fine-tune mBERT on TAR and MT datasets and evaluate their accuracy on the dev test of the respective tasks. That is, in order to study the impact of the fine-tuning dataset we optimize the model on TAR, but evaluate on the MT dev set, and vice versa.