Pronoun Translation in English–French Machine Translation:An Analysis of Error Types
Table 1: Comparison between the DiscoMT 2015 and PROTEST manual evaluations
['[EMPTY]', 'Compatible categories PROTEST', 'Compatible categories DiscoMT', '[ITALIC] official  [ITALIC] DiscoMT']
To compare our results with the original shared task evaluation, we first identified a PROTEST-style category for each pronoun example in the DiscoMT 2015 evaluation set (210 pronouns) using the manual annotations in DiscoMT2015.test. they pronouns from the PROTEST test suite (after removing all instances of you). For reference, we also include the original Acc+OTHER scores from DiscoMT 2015 computed over the full evaluation set.