On Measuring and Mitigating Biased Inferences of Word Embeddings
Table 10: SNLI dev/test accuracies before debiasing GloVe embeddings (orig) and after debiasing gender, nationality, and religion.
['SNLI Accuracies (GloVe)', 'SNLI Accuracies (GloVe) orig', 'SNLI Accuracies (GloVe) -gen', 'SNLI Accuracies (GloVe) -nat', 'SNLI Accuracies (GloVe) -rel']
So the scores actually improve slightly after this bias attenuation! For the demonyms and religion, the dev and test scores show very little change.