WAC: A Corpus of Wikipedia Conversations for Online Abuse Detection
Table 4: Macro Precision, Recall and F-measure obtained by the 3 tested methods.
['[BOLD] Ground Truth  [BOLD] Dataset', '[BOLD] Perspective - Toxicity Prec.', '[BOLD] Perspective - Toxicity Recall', '[BOLD] Perspective - Toxicity  [ITALIC] F-measure', '[BOLD] Perspective - Severe toxicity Prec.', '[BOLD] Perspective - Severe toxicity Recall', '[BOLD] Perspective - Severe toxicity  [ITALIC] F-measure', '[BOLD] Hybrid method Prec.', '[BOLD] Hybrid method Recall', '[BOLD] Hybrid method  [ITALIC] F-measure']
We now illustrate the interest of our corpus and platform to assess the performance of the Google Perspective API as well as our own hybrid method. The way the data is split between train, development, and test sets is described in a file provided with the data. We assess the performance in terms of Precision, Recall and F-measure, separately for the 3 datasets constituting WAC (Personal attack, Aggression and Toxicity).