Machine Translation of Restaurant Reviews:New Corpus for Domain Adaptation and Robustness
Table 4: Robustness to capital letters (see Section 4.2). Foursquare-test’s source side has been set to upper, lower or title case. The first column is case sensitive BLEU on Foursquare-test. “LC to cased” always gets the same scores because it is invariant to source case.
['Model', 'BLEU', 'Case insensitive BLEU Upper', 'Case insensitive BLEU Lower', 'Case insensitive BLEU Title']
To better evaluate the robustness of our models to changes of case, we built 3 synthetic test sets from Foursquare-test, with the same target, but all source words in upper, lower or title case.