Probing Multilingual Sentence Representations With X-Probe
Table 1: Mean and standard deviations for the absolute performance for each probing task, across languages and encoders
['Task', '[ITALIC] μ', '[ITALIC] σ']
An immediate surprising takeaway from our results is the (perhaps counter-intuitive) fact that transferred representations are not necessarily worse at probing tasks than trained representations are. In particular, a task that appears to stand out is SentLen, with transferred encoders displaying considerably improved performance in five out of six cases.