Like instruction loss in ChatGPT, Whisper has translation loss and it doesn't seem relevant but I wonder if it is the key of metrics. Talks about recognition accuracy but nothing about translation. A loss which is not directly related to your target metric but helps a lot in WER.