Towards Evaluating the Robustness of Chinese BERT Classifiers
Table 4. Human performances compared with BERT classifiers in original dataset and adversarial dataset.
['Dataset', 'Clean', 'Adversarial']
We find that our adversarial text barely impacts the human perception, since the human performance on adversarial data is only 4\% lower than the clean data, in contrast to the huge performance drop of BERT classifiers from 82\% to 0\%.