Model Comparison for Semantic Grouping
Table 5: Comparison of Spearman correlations on the STS datasets between the AIC corrections for the diagonal covariance Gaussian and spherical covariance Gaussian likelihood functions.
['Embedding', 'Method', 'STS12', 'STS13', 'STS14', 'STS15', 'STS16', 'Average']
We compute the average AIC of the two Gaussians using FastText embeddings. The diagonal covariance Gaussian has an average AIC of -4738, while the spherical has an average AIC of -3945. As we can see, the diagonal Gaussian covariance likelihood produces a better similarity measure.