AdvCodec: Towards A Unified Framework for Adversarial Text Generation
Table 6: BlackBox attack results on QA in terms of exact match rates and F1 scores. The transferability-based blackbox attack uses adversarial text generated from whitebox models (annotated as (w)) to attack different blakcbox models (annotated as (b)).
['From', 'Attack', '[EMPTY]', 'Position Targeted Attack Adv(Sent)', 'Position Targeted Attack Adv(Word)', 'Answer Targeted Attack Adv(Sent)', 'Answer Targeted Attack Adv(Word)', 'Baseline (untargeted) AddSent']
Blackbox Attack. We also transfer adversarial texts generated from whitebox attacks to perform blackbox attacks. All our proposed methods outperform the baseline method(AddSent) when transferring the adversaries among models with same architectures.