Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Table 8: Comparison of time spent in seconds in computing the CTC loss function and gradient in one epoch for two different implementations. Speedup is the ratio of CPU CTC time to GPU CTC time.
['Language', 'Architecture', 'CPU CTC Time', 'GPU CTC Time', 'Speedup']
The GPU implementation saves us 95 minutes per epoch in English, and 25 minutes in Mandarin. This reduces overall training time by 10-20%, which is also an important productivity benefit for our experiments.