SPEAKER-AWARE SPEECH-TRANSFORMER
Table 1: CER[%] of SAST models with different locations of SAM. Gains are relative to our ST baselilne on test set.
['Layer', 'Dev', 'Test', 'Gain']
It’s clear that higher level acoustic representation is more helpful for SAM to calculate the soft speaker embedding vector. It’s in line with our expectations since higher encoder block outputs more abstract features. In the following experiments, the speaker attention module is located at the highest block of encoder.