How multilingual is Multilingual BERT?
(a)
['[EMPTY]', 'hi', 'ur']
M-Bert’s ability to transfer between languages that are written in different scripts, and thus have effectively zero lexical overlap, is surprising given that it was trained on separate monolingual corpora and not with a multilingual objective.