Sentence-level quality estimation by predicting HTER as a multi-component metric
Table 2: Performance of the 4 different approaches for predicting HTER for English-German (*) indicates a significant improvement (α=0.1) over the baseline
['method', 'dev', 'test2017', 'test2016']
MLP4 achieves higher correlation score than the baseline, but the difference is small and it is significant only for the development set. When compared to the other two methods, though, MLP4 achieves a significant improvement. In contrast to the direction German-English, in English-German the MLP with one output performs worse than the baseline. 4×SVM fails to predict HTER as its predictions achieve zero correlation. Since the individual models failed to predict the post-editing operations separately, this may be an indication that among the 4 post-editing operations in English-German there are dependencies which are stronger than the ones in German-English.