DQI: Measuring Data Quality in NLP
Table 9: Term 1 for DQIc5
['[BOLD] Split', '[BOLD] ISIM=0.3', '[BOLD] ISIM=0.4', '[BOLD] ISIM=0.5', '[BOLD] ISIM=0.6']
The first term computes if the sentence similarity across a given sample meets a threshold, which is a hyperparameter. This sum should be low and so the term should be high, because if the similarity between premise hypothesis pairs is far from the hyperparameter, the sample might give rise to spurious bias.