Affective Behaviour Analysis of On-line User Interactions:Are On-line Support Groups more Therapeutic than Twitter?
Table 1: Performance of the thread extraction algorithm on a set of 100 manually constructed trees.
['[BOLD] Approach', '[BOLD] Acc', '[BOLD] P', '[BOLD] R', '[BOLD] F1']
To evaluate the performance of the thread extraction algorithm, 2 annotators have manually constructed the trees for 100 conversations. The performance of the algorithm on this set of 100 conversations is evaluated using accuracy and standard Information Retrieval evaluation metrics of precision, recall, and F1 measure. The turn-level percent agreement between the 2 annotators is 97.99% and Cohen’s Kappa Coefficient is 83.80%.