Integer Programming Ensemble of Temporal Relations Classifiers
Table 10: SemEval2016 results: The results of individual ensembles and precision threshold values
['Ensemble composition', 'Precision threshold', 'Precision', 'Recall', 'F1 score', '[EMPTY]']
There results are listed in the order, in which the ensembles were tested. The symbol △ indicates that the F1 score is better than any previous F1 scores. At each stage, the results were checked to see if the ensemble score was improving. If there was a deterioration, we increased the precision threshold, or replaced a classifer with an alternative one. Results indicate that a precision threshold of 0.65 works best. If we increased the threshold to 0.70, the recall score suffered, because too few classifiers were able to nominate relations to the ensemble. Further work might be undertaken to establish the optimum precision threshold, as it obviously depends on the precision of the classifiers available to the ensemble and other factors.