Point-less: More Abstractive Summarization with Pointer-Generator Networks
Table 3. Average value of pgen during the end of training and test time.
['Model', 'train  [ITALIC] pgen', 'test  [ITALIC] pgen']
The baseline has a pgen of 0.18 on average, which is in line with the findings of See et al. The Multihead does not change this behaviour. While the Dropout model uses the generator significantly more during training, during test time it falls back to the same value as the baseline.