Learning to generate one-sentence biographies from Wikidata
Table 2: Language model perplexity across templated datasets.
['Templates', 'dev']
We observe decreasing perplexity for data with greater fact value templating. title indicates templating of entity names only, while full indicates templating of all fact values by token index as described in \newciteLeBret16. This shows that templating is an effective way to reduce the sparsity of a task, and that titles account for a large component of this.