Text Understanding from Scratch
Table 5: Amazon review datasets. Column “total” is the total number of samples for each score. Column “full” and “polarity” are number of samples chosen for full score dataset and polarity dataset, respectively.
['[EMPTY]', 'Total', 'Full', 'Polarity']
This dataset contains review texts of extremely variate character lengths from 3 to 32,788, in which the mean is around 764. To construct a sentiment analysis dataset, we chose review texts with character lengths between 100 and 1014. Apart from constructing from the original 5 score labels, we also construct a sentiment polarity dataset in which labels 1 and 2 are converted to negative and 4 and 5 positive. There are also large number of duplicated reviews in which the title and review text are the same. We removed these duplicates.