ASSESSING THE TOLERANCE OF NEURAL MACHINE TRANSLATION SYSTEMS AGAINST SPEECH RECOGNITION ERRORS
Table 2: Average utterance-level translation TER and ΔTER scores for the MMT and Neural MT systems. The average Neural MT TER scores are 3% better than the PBMT counterpart.
['SysID', 'mmt TER ↓', 'mmt ΔTER ↓', 'neural TER', 'neural ΔTER', 'difference TER', 'difference ΔTER']
Although the average TER scores from the mmt outputs are higher, the ΔTER scores are lower than their neural counterparts, implying that the mmt SLT outputs are closer to their gold standard MT outputs. This may suggest that NMT is more sensitive to local changes to an input caused by minor ASR errors.