Modeling Confidence in Sequence-to-Sequence Models
Table 1: Segment-level confidence estimation for MT. First two columns: Percentage of found errors when selecting 10% and 20% of the data; Final two columns: F-score when using oracle threshold and thresholds optimized on pseudo-labels
['Model', '10%', '20%', 'Oracle', 'Pseudo-label']
The first concern in the experiments is the performance on segment-level quality estimation for machine translation.