Examining Gender and Race Biasin Two Hundred Sentiment Analysis Systems
Table 7: Analysis of race bias: Summary results for 219 submissions from 50 teams on the Equity Evaluation Corpus (including both sentences with emotion words and sentences without emotion words).
['Task Bias group', '#Subm.', 'Avg. score diff. AA↑–EA↓', 'Avg. score diff. AA↓–EA↑']
The table has the same form and structure as the gender result tables. Observe that the number of submissions with no statistically significant score difference for sentences pertaining to the two races is about 5–11 (about 11% to 24%) for the four emotions and 3 (about 8%) for valence. These numbers are even lower than what was found for gender.