OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings
Table 1: Intrinsic Bias Measurement: Gender bias contained by embeddings. There are 3 WEAT tests (a score closer to 0 is better) results in this table : (1) with stereotypically gendered occupation words, (2) with work versus home related words, and (3) math versus art related words. ECT also measures bias and a higher score implies less bias Bias1.
['Embedding', 'WEAT (1)', 'WEAT (2)', 'WEAT (3)', 'ECT']
It also shows results for the Embedding Coherence Test (ECT) Bias1, showing the association of vectors from X (gendered words) with a list of attribute neutral words Y (occupation) using the Spearman Coefficient. The score ranges in [−1,1] with 1 being ideal. OSCaR performs similarly to the other debiasing methods in removing bias, always significantly reducing the measured intrinsic bias.