CompiLIG at SemEval-2017 Task 1: Cross-Language Plagiarism Detection Methods for Semantic Textual Similarity
Table 2: Official results of our submitted systems on SemEval-2017 STS track 4 evaluation dataset.
['[BOLD] Methods', '[BOLD] SNLI (4a)', '[BOLD] WMT (4b)', '[BOLD] Mean']
Dataset, annotation and evaluation systems are presented in SemEval-2017 STS task description paper Agirre et al. (track 4a), on which we ranked \nth1 with more than 83% of correlation with human annotations. Conversely, correlations on the WMT corpus (track 4b) are strangely low. This difference is notable on the scores of all participating teams Agirre et al. This might be explained by the fact that WMT was annotated by only one annotator, while the SNLI corpus was annotated by many.