Neural Response Generation with Dynamic Vocabularies
Table 4: Ground truth word coverage.
['[ITALIC] N', '0', '100', '1k', '3k', '5k', '10k']
(note that all vocabularies share the same function words). We can see that when selecting top 1000 content words, the target vocabularies on average can cover about 80% words appearing in the ground truth responses, which is a good balance between efficiency and efficacy. The numbers in the table indicate that useful words can be accurately predicted by the word selection model in DVS2S, and the learning approach generalizes well on the test data. The results are also consistent with the good performance of DVS2S on BLEUs.