Almost Unsupervised Text to Speech and Automatic Speech Recognition
Table 1: The comparison between our method and other systems on the performance of TTS and ASR.
['Method', 'MOS (TTS)', 'PER (ASR)']
We first compare these systems on the TTS quality in terms of MOS score. The MOS score of the ground truth (GT) is 4.54, while 3.21 for GT (Griffin-Lim). Supervised that leverages all the paired data can achieve the MOS score of 3.04, which can be regarded as the upper bound of our method. Pair-200 that leverages only 200 paired data cannot generate any meaningful speech sequence, where we mark its MOS with Null. Our method achieves 2.68 points in terms of MOS, greatly outperforming the Pair-200 baseline, and is just 0.34 points lower than the Supervised that leverages the full paired data. In terms of the accuracy on ASR, our method can achieve 11.7% PER while Pair-200 achieves 72.3% PER, which is much worse than our method.