Gender-preserving Debiasing for Pre-trained Word Embeddings
Table 2: Accuracy for solving word analogies.
['Embeddings', 'sem', 'syn', 'total', 'MSR', 'SE']
“a is b as c is to d”. that finds →d that has the maximum cosine similarity with (→b−→a+→c). We use the semantic (sem) and syntactic (syn) analogies in the Google analogy dataset Mikolov et al. (in total contains 19,556 questions), MSR dataset (7,999 syntactic questions) Mikolov et al. (SE, 79 paradigms) Jurgens et al. We see that there is no significant degradation of performance due to debiasing using the proposed method.