ASAPP-ASR: Multistream CNN and Self-Attentive SRUfor SOTA Speech Recognition
Table 2: WER (in %) comparison of 12-layer Transformer and 12-layer SRU for N-best rescoring.
['[BOLD] Rescoring Model', '[BOLD] Dev clean', '[BOLD] Dev other', '[BOLD] Test clean', '[BOLD] Test other']
Additionally, we show that the perplexity improvement achieved by the 12-layer SRU model transfers directly to a WER improvement when used for candidate rescoring. In all dev and test sets the 12-layer SRU achieves a lower WER than the Transformer model.