WikiAtomicEdits: A Multilingual Corpus of Wikipedia Editsfor Modeling Language and Discourse
Table 8: Insertion accuracy on the test set.
['[EMPTY]', 'General LM', 'Discr. Model']
We see that the discriminitve model trained on insertions directly performs better than the general LM by at least 1% absolute accuracy on every language, and by 3.8% absolute on average. et al. compared to ∼ 1 million for the discriminative model.