Depression and Self-Harm Risk Assessment in Online Forums
Table 5: Models’ performance on RSDD’s validation set with different post selection strategies and values of npost. CNN-E corresponds to the earliest strategy with npost=400 and CNN-R corresponds to the random strategy with npost=1500.
['Post Selection', '[ITALIC] nposts=400 Precision', '[ITALIC] nposts=400 Recall', '[ITALIC] nposts=400 F1', '[ITALIC] nposts=1500 Precision', '[ITALIC] nposts=1500 Recall', '[ITALIC] nposts=1500 F1']
For users with more than the maximum number of posts npost, a post selection strategy dictates which posts are used as input to the model. Selecting a user’s earliest posts performs the worst regardless of npost’s value, though the differences in F1 are smaller when npost=400. Randomly selecting posts for each user performs the best across all metrics when npost=1500, with a large increase in precision over selecting users’ earliest posts and a small increase over choosing users’ latest posts.