Parallel sequence tagging for concept recognition
Table 1: Upper bound of annotation performance (F1-score) when using the CoNLL format, comparing different simplification strategies.
['Unification Unnesting', 'first-span keep-shorter', 'first-span keep-longer', 'full-span keep-longer', 'last-span keep-longer']
After this round-trip conversion, the annotations are run through the official evaluation suite provided by CRAFT. These numbers mark the upper limit for a system trained on input data in CoNLL format. For all annotation sets, using the first-span and keep-longer strategies achieved the highest F1-score.