Jointly Trained Transformers models for Spoken Language Translation
Table 5: Cascaded SLT systems trained using augmented data.
['[EMPTY]', 'Oracle Text Dev set', 'Oracle Text Test set', 'ASR hypothesis Dev set', 'ASR hypothesis Test set']
To reduce the mismatch between the ASR hypothesis and the oracle text, the training corpus for MT systems are augmented with the ASR hypothesis. Rows 1,2 and 3 are the different cascaded SLT systems with different input/output granularites. Column 2, 3 are the performances of cascaded SLT system evaluated with oracle text and column 4, 5 are the performances of cascaded SLT systems evaluated with ASR hypothesis. The models trained from scratch with the augmented data and the models which are initially trained on clean data and later fine-tuned for augmented data have given the similar performance.