Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
(a) VCTK
['Speaker', 'Gender', 'Naturalness', 'Similarity']
The tone and style of LibriSpeech utterances varies significantly between utterances even from the same speaker. In some examples, the speaker even tries to mimic a voice in a different gender. As a result, comparing the speaker similarity between different utterances from a same speaker (i.e. self-similarity) can sometimes be relatively low, and varies significantly speaker by speaker. Because of the noise level in LibriSpeech recordings, some speakers have significantly lower naturalness scores. This again varies significantly speaker by speaker. In contrast, VCTK is more consistent in terms of both naturalness and self-similarity.