RNN-T for Latency Controlled ASR WITH IMPROVED BEAM SEARCH
Table 2: Impact of beams on WER / Throughput / rtf@40 for vid-noisy
['Expand Beam', 'State Beam', 'WER', 'Throughput', 'rtf@40']
A and B at inference time. This boosts the ‘throughput‘ by around 22 percent and decrease rtf@40 by 20 percent with negligible impact on WER. We achieve a ‘throughput‘ of 65 and rtf@40 of .60 with expand_beam = 2.3 and state_beam = 4.6, compared to a ‘throughput‘ of 53 and rtf@40 of .75 without the improved beam search.