Harnessing Indirect Training Data for End-to-End Automatic Speech Translation: Tricks of the Trade
Table 5: Effect of pretraining (PT), when added to the baseline or the fine-tuned (FT) baseline.
['Dataset AST + TTS', 'Bérard 12.58922', 'Δ PT 2.60831', '+ FT 14.34397', 'Δ PT 2.00668']
Pretraining improves the AST + TTS system by +2.6 BLEU and +2.0 BLEU with fine-tuning, improves the MuST-C + TTS system by +2.7 BLEU and +2.2 BLEU with fine-tuning, and improves the MuST-C + MT + TTS system by +4.2 BLEU and +1.4 BLEU.