An Investigation of Transfer Learning-Based Sentiment Analysis in Japanese
Table 6: Comparison of results using large and small corpora. The small corpus is uniformly sampled from the Japanese Wikipedia (100MB). The large corpus is the entire Japanese Wikipedia (2.9GB).
['Model', 'Yahoo Binary']
We also investigate whether the size of the source language model affects the sentiment analysis performance on the Yahoo dataset. This is especially important for low-resource languages that do not usually have large amounts of data available for training. Thus, for effective sentiment analysis, a large corpus is required for pre-training BERT.