Redditors in Recovery: Text Mining Reddit to Investigate Transitions into Drug Addiction
TABLE II: Transition Classifier Results Summary. Table displays test-set performance of Random Forest with 170 trees (selected using grid search and 10-fold cross validation) using different features. Model trained on users’ first 6 months of posts and predicts transitions in the subsequent 12 months. Number of train and test set examples were 352 and 88, respectively.
['Model', 'Accuracy', 'F1 Score']
We use categorical accuracy and F1 score to evaluate the transition classifier. A baseline model, which used only Doc2Vec embeddings, achieved a modest 69.3% test-set accuracy.