Generating multilingual voices using speaker space translation based on bilingual speaker data
Table 4: MOS similarity scores - English and Spanish.
['Voice ID pairs', 'MOS', 'Std. Dev.']
Similarity: A similarity experiment (Test 3) examined to what extent speech in a different language can be identified as being from the same speaker. 84 pairs of sentences, with one sentence in English and one in Spanish, using seven different voice combinations Listeners were asked to rate the voice similarity for each pair of sentences on a scale from (1) Very Different to (5) Very Similar. The higher the score the higher the perceived similarity between pairs of voices in the two languages. Matched voices with cross-lingual transfer scored higher. Pairs 3−3en and 6−6en scored highest, showing the model was performing better for Spanish to English cross-lingual transfer than for English to Spanish. The two mixed voice combinations were rated lower than the same-voice combinations and the difference was statistically significant (p<0.001). The bilingual speaker was perceived as less similar than some combinations, probably because the original recordings in each language had slightly different style requirements.