Privacy-preserving Neural Representations of Text
Table 2: Comparisons between baselines and best adversaries. All metrics reported in this table are accuracies.
['[EMPTY]', 'Baselines Lower bound (most', 'Baselines Lower bound (most', 'Baselines Upper bound', 'Baselines Upper bound', 'Best adversaries', 'Best adversaries', 'Best adversaries', 'Best adversaries']
First of all, we observe that apart from gender on the German dataset, the trained baseline outperforms the most frequent class baseline by a wide margin (8 to 25 absolute difference). Second of all, the attacker is able to outperform the most frequent class baseline overall, even in the raw setting. In more details, for age, the adversary is well over the baseline in all cases except US. On the other hand, gender seems harder to predict: the adversary outperforms the most frequent class baseline only in the +demo setting.