Predicting Annotation Difficulty to Improve Task Routing and Model Performance for Biomedical Information Extraction
Table 3: Pearson correlation coefficients of sentence difficulty predictions.
['[EMPTY]', '[BOLD] P', '[BOLD] I', '[BOLD] O']
Rows 1-4 correspond to individual models, and row 5 reports the ensemble performance. Columns correspond to label type. Results from all models outperform the baseline SVR model: Pearson’s correlation coefficients range from 0.550 to 0.622. The regression correlations are the lowest.