Review-guided Helpful Answer Identification in E-commerce
Table 3. Ablation experiments with reported F1 scores
['Models', 'Sports', 'Health', 'Phones', 'Toys']
To investigate the effectiveness of each component in RAHP, we conduct ablation tests by removing different modules of RAHP-Base. The results show that the model without the RA coherence component (RAHP w/o RA coherence) suffers a large decrease, indicating that considering the opinion coherence between the answer and reviews contribute to the final performance. One interesting phenomenon is that different domains suffer different degrees of such performance decrease. For example, the Health domain has a larger degradation compared with other domains. This may due to the fact that questions and answers in this domain are much more subjective and diverse, making the reviews are less discriminative to help identify helpful answers.