Gender Bias in Coreference Resolution:Evaluation and Debiasing Methods
Table 2: F1 on OntoNotes and WinoBias development set. WinoBias results are split between Type-1 and Type-2 and in pro/anti-stereotypical conditions. * indicates the difference between pro/anti stereotypical conditions is significant (p
['Method E2E', 'Anon.', 'Resour.', 'Aug.', 'OntoNotes  [BOLD] 67.7', 'T1-p  [BOLD] 76.0', 'T1-a 49.4', 'Avg 62.7', '∣ Diff ∣ 26.6*', 'T2-p  [BOLD] 88.7', 'T2-a 75.2', 'Avg 82.0', '∣ Diff ∣ 13.5*']
WinoBias Reveals Gender Bias Table Systems were evaluated on both types of sentences in WinoBias (T1 and T2), separately in pro-stereotyped and anti-stereotyped conditions ( T1-p vs. T1-a, T2-p vs T2-a). E2E and Feature were retrained in each condition using default hyper-parameters while Rule was not debiased because it is untrainable. We evaluate using the coreference scorer v8.01 Pradhan et al.