Span-based Joint Entity and Relation Extraction with Transformer Pre-training
Table 3: Investigation of different entity span representations e(s) (summing and averaging of entity’s tokens).
['[BOLD] Pooling', '[BOLD] Entity F1', '[BOLD] Relation F1']
Finally, we investigate different options for the entity span representation e(s) other than conducting a max pooling over the entity’s tokens, namely a sum and average pooling Sum pooling improves the performance to 80.3/68.2%. Max pooling, however, outperforms this by another increase of 3.8% and 2.8% respectively.