Double-Hard Debias:Tailoring Word Embeddings for Gender Bias Mitigation
Table 2: WEAT test of embeddings before/after Debiasing. The bias is insignificant when p-value, p>0.05. Lower effective size (d) indicates less gender bias. Significant gender bias related to Career & Family and Science & Arts words is effectively reduced by Double-Hard GloVe. Note for Math & Arts words, gender bias is insignificant in original GloVe.
['[BOLD] Embeddings', '[BOLD] Career & Family  [ITALIC] d', '[BOLD] Career & Family  [ITALIC] p', '[BOLD] Math & Arts  [ITALIC] d', '[BOLD] Math & Arts  [ITALIC] p', '[BOLD] Science & Arts  [ITALIC] d', '[BOLD] Science & Arts  [ITALIC] p']
For Career & Family and Science & Arts, Double-Hard GloVe reaches the lowest effect size, for the latter one, Double-Hard GloVe successfully makes the bias insignificant (p-value >0.05). Note that in WEAT test, some debiasing methods run the risk of amplifying gender bias, e.g. for Math & Arts words, the bias is significant in GN-GloVe while it is insignificant in original GloVe embeddings. Such concern does not occur in Double-Hard GloVe.