DQI: Measuring Data Quality in NLP
Table 5: Term 1 for DQIc3
['[BOLD] Split', '[BOLD] SIML=0.3', '[BOLD] SIML=0.35', '[BOLD] SIML=0.4']
The first term has a hyperparameter that dictates the minimum similarity threshold. Over the dataset, given each sentence in turn, all other sentences are checked against it and those which don’t meet the threshold are counted. The standard deviation of this series should be low, and is inversely proportional to the term’s value. The accountability of this term is similar to class imbalance. This might indicate that, AFLite is not considering imbalance due to sentence similarity.