Concept-based Abstraction-Aggregation Network forInterpretable Document Classification
Table 3: Case-level concept-based explanation. Here, each ID is associated with a concept, i.e., abstraction-attention unit. Scores and weights (following each keyword) are calculated with Eq. (7) and (8). ‘-’ represents special characters.
['[BOLD] ID', '[BOLD] Score', '[BOLD] Keywords']
First, we investigate if AAN attends to relevant keywords when it is making predictions, which can be accomplished by visualizing attention weights (see Fig. This is a Business news article from Newsroom and we observe that the most relevant keyword that AAN detects is boston. Other important keywords include investment, economist, marketing and com. Compared with Fig. Moreover, boston may be related with corporation (e.g., bostonglobe or gerritsen of boston) or city, thus, it appears in both concepts 8 (corporations) and 9 (locations).