A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistency
Table 1: Sentence Labeling Performance. The WCL and W00 results are based on the 10-fold cross validation performance while the results for DEFT (i.e., Textbook and Contract) are obtained on the test sets. The proposed model is significantly better the baselines (p<0.01).
['[EMPTY]', 'WCL P', 'WCL R', 'WCL F1', 'W00 P', 'W00 R', 'W00 F1', 'Textbook P', 'Textbook R', 'Textbook F1', 'Contract P', 'Contract R', 'Contract F1']
The performance gap is substantial on the Textbook and Contract datasets (i.e., up to 3.3% improvement on the absolute F1 score over the second best system CVT), clearly demonstrating the effectiveness of the proposed model in this work. This table also shows that our model can benefit from the contextualized embeddings (e.g., BERT [Devlin:18]) as BERT can significantly improve the proposed model over three out of four datasets.