Deliberation Model Based Two-Pass End-to-End Speech Recognition
Table 3: WERs (%) with or without AE layers.
['ID', 'Model', 'WER']
To help the deliberation decoder better adapt to the shared encoder, we add AE layers for dedicated encoding for the deliberation decoder. The AE consists of a 2-layer LSTM with 2,048 hidden units followed by 640-dimensional projection per layer. Beam search is used for decoding. the model performs around 4% better than without (E4). Similarly, we apply AE to the LAS beam search (B1→B2), and obtain similar improvements.