A Deep Ensemble Model with Slot Alignment for Sequence-to-Sequence Natural Language Generation
Table 12: Automatic metric scores of our ensemble model evaluated on the test sets of the TV and Laptop datasets, and compared against SCLSTM. The ERR column indicates the slot error rate, as computed by the RNNLG toolkit (for our models calculated in post-processing).
['[EMPTY]', '[BOLD] TV  [BOLD] BLEU', '[BOLD] TV  [BOLD] ERR', '[BOLD] Laptop  [BOLD] BLEU', '[BOLD] Laptop  [BOLD] ERR']
We believe the higher error rate of our model can be explained by the significantly less aggressive slot delexicalization than the one used in SCLSTM. That, however, gives our model a greater lexical freedom and, with it, the ability to produce more natural utterances.