Cross-lingual Word Analogies using Linear Transformations between Semantic Spaces
Table 1: Number of word pairs for each language and each analogy type.
['Semantic', 'family', 'En 24', 'De 24', 'Es 20', 'It 20', 'Cs 26', 'Hr 41']
We combine and extend available corpora for monolingual word analogies in English (En ) Mikolov et al. (It) Berardi et al. Czech (Cs) Svoboda and Brychcín Svoboda and Beliga We consider only those analogy types, which exist across all six languages (three semantically oriented and six syntactically oriented analogy types). For all languages, questions composed of single words are taken into account (i.e., no phrases). In the following list we briefly introduce each analogy type and describe the changes and extensions we have made compared with the original corpora: For each analogy type we process all combinations of pairs between languages a and b (e.g., for the category family and the transformation from Czech to German, we have 26×24=624 questions). In the case a=b (i.e., monolingual experiments), we omit the questions composed from two same pairs (e.g., for the category family in Italian, we have 20×19=380 questions). The final accuracy is an average over accuracies for individual categories. By averaging the accuracies each analogy type contributes equally to the final score and the results are comparable across languages. In the following text, Acc@1 denotes the accuracy considering only the most similar word as a correct answer. Acc@5 assumes that the correct answer is in the list of five most similar words. All accuracies are expressed in percentages.