EELECTION at SemEval-2017 Task 10:Ensemble of nEural Learners for kEyphrase ClassificaTION
Table 4: Stackers+CNNs+AB-LSTMs confusion matrix.
['[EMPTY]', '[EMPTY]', 'Prediction Material', 'Prediction Process', 'Prediction Task']
Error analysis: than for the other two classes. This mismatch is because PROCESS and TASK can describe similar concepts, resulting in rather subtle differences. E.g., looking at various ‘analysis’ instances, we find that some are labeled as PROCESS and others as TASK in the gold data. This holds even for a few seemingly very similar keyphrases (‘XRD analysis’, ‘FACS analysis’). The ensemble has trouble labeling this correctly, tagging 6 of 17 ‘analysis’ instances wrongly. Beyond further suspicious labelings in the data (e.g., ‘nuclear fissions reactors’ as Task), other cases could have been resolved by knowledge of syntax (‘anionic polymerization of styrene’ is a process, not a material) and/or POS tags, and by knowledge of common abbreviations such as ‘PSD’.