Beyond Leaderboards: A survey of methods for revealingweaknesses in Natural Language Inference data and models
Figure 1: Number of premise-hypothesis pairs in an RTE dataset following lexical patterns, spuriously skewed towards Entailment [mccoy2019right].
['Heuristic', '[ITALIC] E', '¬ [ITALIC] E']
The exploitation of those correlations in order to produce the expected prediction is known as the “Clever Hans Effect”, named after a horse that was believed to perform arithmetic tasks but was shown to react to subtle body language cues of the asking person [Johnson1911].