A Unified Feature Representation for Lexical Connotations
Table 3: Lexicon annotation results. Fleiss’ κ and % agreement are averaged across nouns and adjectives. Lex % is agreement between annotators and the lexicon. NC indicates non-conflicting value agreement.
['[BOLD] Aspect', '[BOLD] Avg  [ITALIC] κ', '[BOLD] Avg % Agree', '[BOLD] Lex % Agree', '[BOLD] Lex % NC']
Annotators are given a word w, along with its definitions (for all senses) and related words, and annotate connotation independent of word sense. This setup mimics We select as the final annotator label the majority vote of three annotators.