Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes
Table 12: Model performance (occupation proportion vs embedding bias) for individual models trained on each decade compared to a single model trained for all decades. Note that the r-squared value for the combined model is .235.
['Year', 'r-squared with individual model', 'MSE with individual model', 'MSE with combined model']
This single model performs similarly to individual models trained for each decade’s embedding. The r-squared values of the embedding bias vs. occupation correlation in each decade are also similar to that of the aggregate correlation.