Build it Break it Fix it for Dialogue Safety:Robustness from Adversarial Human Attack
Table 13: Full table of results from experiments on the single-turn standard and adversarial tasks. F1, precision, and recall are reported for the offensiveclass, as well as weighted F1.
['[EMPTY]', '[BOLD] Baseline model  [ITALIC] A0', '[ITALIC]  [BOLD] Standard [BOLD]  models  [ITALIC] S1', '[ITALIC]  [BOLD] Standard [BOLD]  models  [ITALIC] S2', '[ITALIC]  [BOLD] Standard [BOLD]  models  [ITALIC] S3', '[ITALIC]  [BOLD] Adversarial [BOLD]  models  [ITALIC] A1', '[ITALIC]  [BOLD] Adversarial [BOLD]  models  [ITALIC] A2', '[ITALIC]  [BOLD] Adversarial [BOLD]  models  [ITALIC] A3']
5.2.2 Fix it Phase The adversarially trained models Ai prove to be more robust to adversarial attack: on each round of adversarial testing they outperform standard models Si. We report F1, precision, and recall for the offensive class, as well as weighted-F1 for