ELITR Non-Native Speech Translation at IWSLT 2020
Table 3: Weighted average WER for the domains in validation set, and their average. The top line-separated group are offline ASR systems, the bottom are online. Bold numbers are the lowest considerable WER in the group. Kaldi-AMI score on AMI is not considered due to overlap with training data. Bold names are the primary (marked with 1) and secondary (marked with 2) candidates.
['[EMPTY]', 'WER weighted average AMI', 'WER weighted average Antrecorp', 'WER weighted average Auditing', 'avg domain']
We weight it by the number of gold transcription words in each of the documents. We observe that Kaldi-AMI has a good performance on the AMI domain, but it is worse on the others. We assume it is overfitted for this domain, and therefore we do not use it as the primary system.