Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling
Table 5: Results on the out-of-domain test set.
['System', 'P', 'R', 'F1']
For English, in the CoNLL shared task, systems are also evaluated on the out-of-domain dataset. Statistical models are typically less accurate when they are applied to out-of-domain data. Consequently, the predicted syntax for the out-of-domain test set is of lower quality, which negatively affects the quality of GCN embeddings. This suggests that our model is fairly robust to mistakes in syntax. As expected though, our model does not outperform the syntax-agnostic model of DBLP: journals/corr/MarcheggianiFT17.