Offline bilingual word vectors, orthogonal transformations and the inverted softmax
Table 7: “Translation” precision @5, when seeking to retrieve the true translation of an English sentence from a bag of 200k Italian sentences, or vice versa, averaged over 5k samples. We first obtain bilingual word vectors, using either the word dictionary provided by Dinu, or by constructing a phrase dictionary from Europarl. We set ns= 12800 in the inverted softmax.
['[EMPTY]', 'English to Italian: Word dictionary', 'English to Italian: Phrase dictionary', 'Italian to English: Word dictionary', 'Italian to English: Phrase dictionary']
Once again, the inverted softmax performs well when retrieving the Italian translations of English sentences, but is less effective translating Italian sentences into English. However, the performance of Dinu’s method appears to rise more rapidly than other methods as we transition from precision @1 to @5 to @10. Additionally, while Dinu’s method performs better when using the word dictionary @1, it prefers the phrase dictionary @5 and @10.