Shallow Discourse Parsing Using Distributed Argument Representations and Bayesian Optimization
Table 3: Discourse sense classification results, measured by F1, in comparison with the most competitive systems from the shared task.
['System', 'Dev All', 'Dev Explicit', 'Dev Non-expl.', 'Test All', 'Test Explicit', 'Test Non-expl.', 'Blind All', 'Blind Explicit', 'Blind Non-expl.']
Evaluation was performed using the evaluation script provided by the conll16 task organizers. Our system was particularly competitive on the blind test set. (The best performance on non-explicit relations on the blind test set was from ttr, but this system did not attempt to classify explicit relations, and so did not obtain an overall score for all relations.) This suggests that our approach suffered less from overfitting to the dev data. On the other hand, our system’s performance on explicit relations was further behind the best systems, suggesting the need for additional features to handle this case.