Semantic Mask for Transformer based End-to-End Speech Recognition
Table 3: Experiment results on TEDLIUM2.
['[EMPTY]', 'Test']
Semantic mask is complementary to specagumentation, which enables better S2S language modeling training in an E2E model, resulting in a relative 4.5% gain. The experiment proves the effectiveness of semantic mask on a different and smaller dataset.