How to best use Syntax in Semantic Role Labelling
Table 1: Injecting External Syntax Information. Bold number is the best performance in each column, same below.
['[BOLD] Inject.', '[BOLD] Model', '[BOLD] CoNLL’05 WSJ', '[BOLD] CoNLL’05 Brown', '[BOLD] CoNLL’12 Test']
When used as input features, all three representations improve over our baseline system. This shows that syntactic representations provide additional useful information, which is beyond the dynamic context embeddings from ELMo, to SRL task. Both the Input and Auto-Encoder methods work equally well. We conclude that the extra complexity of the auto-encoder model is not justified. In particular, Dep with auto-encoder hurts SRL accuracy (0.6% behind the model with the constituency features).