Achieving Human Parity on AutomaticChinese to English News Translation
(a) Subset-1, n≥609
['#', 'Ave %', 'Ave  [ITALIC] z', 'System']
BLEU scores against single or multiple references. WMT is Reference-WMT, PE is Reference-PE, HT is Reference-HT. Scoring based on sacreBLEU v1.2.3, with signature BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.3 for refs=1. Signature changes to numrefs.2 and numrefs.3 for refs=2 and refs=3, respectively. Note how different scores for Reference-WMT and Reference-PE are compared to Reference-HT and This emphasizes the need for human evaluation.