Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answering
Table 1: The number of error types occurrences and its percentage for two sets of (ces,qes,aes) instances retrieved with and without alignment.
['[BOLD] Error  # (%)', '{( [ITALIC] c, [ITALIC] q, [ITALIC] a)} [ITALIC] all', '{( [ITALIC] c, [ITALIC] q, [ITALIC] a)} [ITALIC] no_ [ITALIC] align']
Overall, the two factors for these error types are both the NMT component and the alignment component in our TAR method. In order to have more quantitative idea of how the error types are distributed across the (ces,qes,aes) examples, we randomly selected an article from SQuAD v1.1 and manually counted the error types. Besides, we divided the total examples into two sets, depending on how the answer translations are retrieved. The first set contains all the (ces,qes,aes) instances, while the second, smaller set, contains only the (ces,qes,aes) instances retrieved when the answer translation is matched as span in the context translation. In this way, we isolate the effect of the alignment component in the answer retrieval and evaluate its impact on the distribution of the error types.