XL-NBT: A Cross-lingual Neural Belief Tracking Framework
Table 4: The test set results on IWSLT for different algorithms
['Model', 'BLEU']
Here we demonstrate some examples for translated dialogs: Human(correct): gibt es irgendwelche eritrean restaurants in die stadt? (is there any eritrean restaurants in the town?) Machine: no, there are no eritrean restaurants in town. would you like a different restaurant? Human(missing) : Wie steht es mit essen? (Is there any Chinese food?) Machine: there is a wide variety of chinese restaurants, do you have an area preference or a price preference to narrow it down? Human(correct) : ich würde den osten der stadt mögen. (I want to try something in the east) Machine: yu garden is a chinese restaurant in the east area. Human(correct) : könnte ich die adresse bekommen, und postcode garden? (Can I obtain the address and postcode of the restaurant?) Machine: phone is xxx-xxxx, address and postcode are xxx new market road Another example is shown below: Human(missing): ich möchte ein restaurant in jedem gebiet finden , und serves essen? (I want to find a restaurant anywhere to serve Scottish food?) Machine: there are no restaurants serving scottish food . would you like to try something else? Human(correct) : ja, wie steht es mit modernen europäischen essen? (how about moderate european food?) Machine: eraina is a great european eatery. what other information can i provide to you? Human(correct) : was ist das telefon? (What is its telephone?) Machine: their phone number is numnum may i help you with anything else? Human(correct) : nein, vielen dank. (no, thanks.) The above generated German dialogs are shown with their English translation to help readers to understand. We have observed that the most frequent two error types are the entity missing and broken grammar. Since IWSLT2014 lies in another domain, its vocabulary is mis-aligned with the spoken dialog vocabulary. Therefore, the NMT decoder fails to generate many ontology words. These errors in the translated dialog corpus can remarkably degrade the DST performance.