Twitter Sentiment Analysis using Distributed Word and Sentence Representation
Table 4: Skipgram vs CBOW vs FastText on LSTM-4 (%)
['[EMPTY]', 'Word2Vec Skipgram', 'Word2Vec CBOW', 'FastText']
Hence, when time is also taken in to consideration, Skipgram is the best model. Hence Skipgram is taken for further testing. Also, CBOW quickly overfits after 5 epochs, even with a dropout of 0.3 on every layer.