1 Introduction
Table 4: Hyperparameters for embedding algorithms.
['Algorithm', 'Hyperparameter', 'Value']
For CBOW, we use the default learning rate. For GloVe, we use a learning rate of 0.01 (as the default of 0.05 resulted in NaNs on 800-dimensional Wiki embeddings). For MC, since we are using our own implementation, we use a learning rate which we found to achieve low loss on Wiki’17.