CONTEXTUAL RNN-T FOR OPEN DOMAIN ASR
Table 3: Precision and Recall for context words across both test sets
['Model', 'Precision', 'Recall']
We also measure robustness of our system using precision and recall of the emission of context words in the model’s hypotheses. A True Positive occurs when a context word from the metadata of the video is correctly output by the model as compared to the reference. A False Positive occurs if the model outputs a context word but it does not appear in the reference. We see an improvement in recall by 4.5% and degradation in precision by 1.2% for the Contextual model compared to the baseline.