Transliteration in Any Language with Surrogate Languages
Table 2: Scores when using top k candidate languages for T. For the top k, we always exclude T from the list. All scores are MRR. *indicates the score is better than the oracle
['Method ∖ Lang', 'ben', 'chv', 'hye', 'kan', 'mzn', 'new', 'tha', 'uzb', 'xmf', 'Avg.']
The ‘Oracle top’ row shows scores from training on the top oracle language, and the ‘Predicted top’ shows the score from the top predicted language. The oracle score is, by definition, always greater than or equal to the predicted ranking. Note that we removed T from all rankings in order to simulate a low-resource setting. The third experiment combines the top k predicted languages into a single prediction result via weighted voting. At test time, each predicted language produces an n-best list with scores for each word in the test set. We combine n-best lists by using the score to vote.