Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
Table 9: Impact of duration of reference speech utterance. Evaluated on VCTK.
['[EMPTY]', '1 sec', '2 sec', '3 sec', '5 sec', '10 sec']
The proposed model depends on a reference speech signal fed into the speaker encoder. Quality saturates at about 5 seconds on VCTK. Shorter reference utterances give slightly better naturalness, because they better match the durations of reference utterances used to train the synthesizer, whose median duration is 1.8 seconds. The proposed model achieves close to the best performance using only 2 seconds of reference audio. The performance saturation using only 5 seconds of speech highlights a limitation of the proposed model, which is constrained by the small capacity of the speaker embedding.