Two-Pass End-to-End Speech Recognition
Table 3: Rescoring WER with first-pass fixed vs. adaptive beam.
['Exp-ID', 'First-pass Max Beam Size', 'SU', 'LU']
To bridge the gap between two-pass 2nd beam search vs. rescoring on SU, we first explore increasing the diversity of rescoring candidates with a larger first-pass RNN-T beam. The table shows that with an adaptive beam (E5), we can achieve similar WER to a fixed but large beam (E3).