Gender-preserving Debiasing for Pre-trained Word Embeddings
Table 4: Spearman correlation between human ratings and cosine similarity scores computed using word embeddings for the word-pairs in the original and balanced versions of the benchmark datasets.
['Embeddings', 'WS Orig', 'WS Bal', 'RG Orig', 'RG Bal', 'MTurk Orig', 'MTurk Bal', 'RW Orig', 'RW Bal', 'MEN Orig', 'MEN Bal', 'SimLex Orig', 'SimLex Bal']
Moreover, the performance of GP (GloVe) on both original and balanced datasets is comparable to that of GloVe, which indicates that the information encoded in GloVe embeddings are preserved in the debiased embeddings, while removing stereotypical gender biases. The autoencoded versions report similar performance to the original input embeddings.