DQI: Measuring Data Quality in NLP
Table 10: Terms 2,3,4,5,6 for DQIc5
['[BOLD] Split', '[BOLD] T2', '[BOLD] T3', '[BOLD] T4', '[BOLD] T5', '[BOLD] T6']
Second Term The second term measures the length variation in the good and bad categories, between the premise and hypothesis. This variation is computed as a mean of differences. The mean should be less so that the model does not get a chance to use hypothesis length as an artifact. Even though the term has a higher value for good category, it appears to be almost the same for both categories.