Combining Neural Networks and Log-linear Models to Improve Relation Extraction
Table 5: Performance of Relation Classification Systems. The †refers to special treatment to the Other class.
['Classifier', 'F']
We further evaluate the proposed systems for the relation classification task on the SemEval dataset. The most important observation is that the hybrid-voting systems VOTE-BIDIRECT and VOTE-BACKWARD achieve the state-of-the-art performance for this dataset, further highlighting their benefit for relation classification. The hybrid-voting STACK-FORWARD system performs less effectively in this case, possibly due to the small size of the SemEval dataset that is not sufficient to training such a deep model.