Learning to Identify Ambiguous and Misleading News Headlines
Table 3: Comparison results of methods identifying ambiguous headlines
['[EMPTY]', 'Precision', 'Recall', 'F-score']
The method with unigram features does not perform well, because this task is different from traditional text classification tasks. The method with CSR features is proved to be effective and outperforms over basic features in precision, owing to its strictness with sentence structures. Our method with all features gets an increase in precision, recall, and F-score comparing with the method with basic features, demonstrating the contribution of CSR features. In addition, we conduct sign-test upon the predict results of basic features and all features. Sign test is a statistical method to test for consistent differences between pairs of observations. The p-value of sign test is 0.0022<0.05, demonstrating the significant efficacy of our method.