Automatically Identifying Complaints in Social Media
Table 7: Complaint prediction results using the original data set and distantly supervised data. All models are based on logistic regression with bag-of-word and Part-of-Speech tag features.
['[BOLD] Model', '[BOLD] Acc', '[BOLD] F1', '[BOLD] AUC']
Results presented in Table 7 show that the domain adaptation approach further boosts F1 by 1 point to 79 (t-test, p<0.5) and ROC AUC by 0.012. [CONTINUE] However, simply pooling the data actually hurts predictive performance leading to a drop of more than 2 points in F1.