Aligning Faithful Interpretations with their Social Attribution
Table 2: The performance of a classifier using quantities of the following tokens in h⊙x: comma, period, dash, escape, ampersand, brackets, and star; as well as the quantity of capital letters and |h⊙x|. Missing cells are cases where we were unable to converge training.
['Model', 'AGNews', 'IMDB', '20News', 'Elec']
The results are compared against a baseline of attempting to predict the decisions based on the same statistics on the full text. Surprisingly, all models show an increased ability to predict their decisions on some level compared to the full text, showing that the highlights selected by these models carry additional information—which was not in the original input—that can be leveraged by the predictor to make decisions.