Abstract
Table 4: Comparison of human classifications to statistical inferences.
['[EMPTY]', '[BOLD] Size', '[BOLD] Overlapping Terms Count', '[BOLD] Overlapping Terms Share', '[BOLD] Consensus Classification Count', '[BOLD] Consensus Classification Share', '[BOLD] Correlation', 'Reliability']
We now compare the results of our statistical inferences to the manually selected dictionaries from previous research. In addition, we present the inter-rater reliability (i. e. Here, a reliability value of 1 indicates a perfect overlap between the classifications in positive and negative groups, whereas a value of 0 denotes that human dictionaries and our statistical inferences are statistically unrelated. Although most ex ante dictionaries feature a large volume of words, many statistically relevant terms are not included. In addition, overlapping terms show a relatively low correlation that is, in some cases, only significant at the 5\char37 level. As a consequence, misclassification and the erroneous exclusion of words limit the suitability of ex ante dictionaries.