Parallelizing Word2Vec in Shared and Distributed Memory
TABLE I: Predictive performances of the models trained from the original word2vec and our optimization on three different training corpora. All the experiments are performed on an Intel Broadwell CPU.
['Corpus', 'Vocabulary Size', 'Word Similarity Original', 'Word Similarity Our', 'Word Analogy Original', 'Word Analogy Our']
Predictive-Performance (Accuracy): Delivering higher throughput is only meaningful when the trained model reaches similar or better predictive accuracy. In order to verify the generalization performance of our techniques, we run the respective codes on three different training corpora as described above. It demonstrates that our optimization generalizes very well to different corpora that have a variety of sizes under different vocabulary settings.