Identifying Personality Traits Using Overlap Dynamics in Multiparty Dialogue
Table 3: Predicting Low, Moderate and High. Evaluation metrics: macro averaged Precision (P), Recall (R) and F1. * if p <0.05, ** if p <0.01. Improved performance compared to random is shown in boldface.
['[EMPTY]', 'P', 'Naive Bayes R', 'F1', 'P', 'Random Guessing R', 'F1']
We compared the performance of the classifier and the baseline over the 10 splits by t-test. The classifier for Agreeableness outperformed the baseline, and the improvements in recall and F1 are statistically significant. The Extraversion classifier also outperformed the baseline but only Recall showed significant improvement. Precision for Conscientiousness, and Recall and F1 for Openness were slightly improved but not significantly. Overall, the performance of the classifiers did not appear to be adequately strong for all the Big 5.