Selection Bias Explorations and Debias Methods forNatural Language Sentence Matching Datasets
Table 4: Evaluation Results with the synthetic dataset, MSRP and SICKSTS dataset. We report the accuracy scores and “%” is omitted.
['[BOLD] Method', '[BOLD] Synthetic', '[BOLD] MSRP', '[BOLD] SICKSTS']
We find that the Debiased Model significantly outperforms the Biased Model on all three datasets. This indicates that the Debiased Model better captures the true semantic similarities of the input sentences. As illustrated, the predictions are more neutral to the leakage feature.