Topics to Avoid: Demoting Latent Confounds in Text Classification
Table 5: Classification accuracy with topic-demoting methods, L2-Reddit dataset.
['[EMPTY]', '[BOLD] In- Domain', '[BOLD] Out-of- Domain']
Finally, we evaluate the impact of our novel training procedure and the quality of our proposed topical confound identification method. We compare our proposed solution, denoted alt-lo, with two alternatives, as before, one with a different learning setup (gr-lo) and one with a different confound representation (alt-lda). Unsurprisingly, the model trained with gradient reversal (gr-lo) performs particularly poorly; this was our primary motivation to explore better learning techniques.