Advances in Pre-Training Distributed Word Representations
Table 3: Results on Word Analogy, Rare Words and Squad datasets with fastText models trained on various corpora (see Table 1) or Common Crawl (see Table 2), and comparison to GloVe models trained on comparable datasets.
['Model', 'Analogy', 'RW', 'Squad']
The 87% accuracy on the word analogy tasks is to our knowledge the best published result so far by a large margin, and much better than existing GloVe models which were trained on comparable corpora. We improved this result further to 88.5% accuracy by adding the sub-word features.