Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentiment Analysis
Table 3: An ablation study of the proposed model. Evaluation metrics are accuracy (Acc) and F1. The best results are in bold.
['[BOLD] Ablation Settings', '[BOLD] Toys & Games Acc', '[BOLD] Toys & Games F1', '[BOLD] Sports & Outdoors Acc', '[BOLD] Sports & Outdoors F1', '[BOLD] News Acc', '[BOLD] News F1']
We observe that compared with these partial models, the full model yields significant improvements on F1. Noted that HIN without both document- and segment-level interactions achieve the best accuracy in Toys & Games dataset, a reasonable explanation is due to the imbalanced distribution of categories. Therefore, consideration the imbalanced distribution, F1 is a comprehensive method for evaluation.