Sparse Overcomplete Word Vector Representations
Таблица 5: Accuracy of three human annotators on the word intrusion task, along with the average inter-annotator agreement [Artstein and Poesio2008] and Fleiss’ κ [Davies and Fleiss1982].
['Vectors', 'A1', 'A2', 'A3', 'Avg.', 'IAA', '[ITALIC] κ']
The inter-annotator agreement on the sparse vectors increases substantially, from 57% to 71%, and the Fleiss’ κ increases from ‘‘fair’’ to ‘‘moderate’’