Neural Headline Generation with Sentence-wise Optimization
Table 3: Effect of using different UNK Post Processing methods on English development set.
['[EMPTY]', '[ITALIC] R1 [ITALIC] R', '[ITALIC] R2 [ITALIC] R', '[ITALIC] RLR']
There are three typical post-processing methods to deal with UNK tokens. A simplest way is to ignore them, and we denote it as Ignore. The third way is to replace the unknown words according to a dictionary built upon the whole training set, and we denote it as Mapping. We conduct experiments on the English development set to investigate the performance of these methods. The fixed vocabulary size in NHG model is set to 30,000. Hence, we decide to utilize it as the default post processing method in our experiments on the test set.