Synthetic and Natural Noise Both BreakNeural Machine Translation
Table 5: Google Translate’s performance with natural errors and the gains from using spell checking.
['Vanilla', 'French Nat', 'Spelling', 'Vanilla', 'German Nat', 'Spelling', 'Vanilla', 'Czech Nat', 'Spelling']
One natural question is if robust spell checkers trained on human errors are sufficient to address this performance gap. To test this, we ran texts with and without natural errors through Google Translate. We then used Google’s spell-checkers to correct the documents.