Discourse Coherence in the Wild: A Dataset, Evaluation and Methods
Table 8: Minority class predictions, F0.5 score on test data.
['System', 'Yahoo', 'Clinton', 'Enron', 'Yelp']
This is in line with evaluation standards in other writing feedback applications Ng et al. Again, the neural models perform best in most domains. However, the results of this experiment in particular show that there is still a large gap between the performance of these models and what might be required for high-precision real-world applications.