A Scientific Information Extraction Dataset for Nature Inspired Engineering
Table 3: Overview of results on the development (dev) and test set of FOBIE for the RBS and SciIE. The relations columns refers to the Relation Extraction (RE) setting. The RBS does not classify relations and is, therefore, not evaluated on this task. Boundaries refers to determining the correct boundaries of arguments and trigger words.
['[EMPTY]', '[EMPTY]', 'Relations P', 'Relations R', 'Relations F1', 'Boundaries P', 'Boundaries R', 'Boundaries F1']
As expected the neural approach outperforms the simple RBS by a large margin. We also evaluate how well SciIE performs on FOBIE with regards to extracting relations. The Relation Extraction (RE) setting is evaluated as a joint task – the presence of spans has to be predicted correctly, as well as the relation types that may hold between them. We do not change the default hyper parameters, apart from setting the maximum span length to 14 tokens. This is required to deal with the longer keyphrases in FOBIE.