Template-free Data-to-Text Generation of Finnish Sports News
Table 2: Comparison of the original hockey news and the aligned sentences, including analysis of lexical diversity.
['[EMPTY]', 'Original Corpus', 'Aligned']
The measure is defined as the number of unique tokens or lemmas divided by the total number of tokens, calculated on every segment of 1,000 tokens separately and averaged across the corpus. STTR is more meaningful than the standard type–token ratio when comparing corpora of substantially different sizes. Both corpora are tokenized and lemmatized using the Turku Neural Parser pipeline Kanerva et al. STTR of the aligned corpus is lower than in the original hockey news on both word and lemma level, indicating a somewhat—but not substantially so—more restricted vocabulary use in our aligned subset.