Paired Comparison Sentiment Scores
Table 3: Example scores from average direct assignment and paired comparisons with the logistic distribution.
['[ITALIC] adjective', '[ITALIC] r\\scriptsize\\em direct', '[ITALIC] r\\scriptsize\\em paired', '[ITALIC] σ\\scriptsize\\it boot']
It is interesting to compare the scores from paired comparisons for words which have obtained the same score from direct assignment on the five grade scale. These can be used to test whether, for ri≠rj, the score difference is significant by computing the p-value 1−Φ(|ri−rj|/√σ2i+σ2j), where Φ is the distribution function of the standard normal distribution. For the words “unpraktisch” and “rüde”, e.g., the p-value is much less than 5% and the difference is therefore statistically significant, although they obtained identical scores on the five grade scale from direct estimation.