Suicidal Ideation and Mental Disorder Detectionwith Attentive Relation Networks
Table 10: Performance of different variants of risk indicator injection
['Model', 'Accuracy', 'Precision', 'Recall', 'F1']
We then conduct ablation study to explore several variants and compare their performance. We compare our complete framework with three different settings of injecting risk indicators. The BiLSTM+concat model concatenates final hidden state with sentiment and topic features. The BiLSTM+RN+sentiment and BiLSTM+RN+topic use single-channel relation network. Relation networks are generally better than BiLSTM with simple feature concatenation, where the performance of the latter model decreased compared to vanilla BiLSTM. The BiLSTM+RN+sentiment model is better than vanilla BiLSTM, while the BiLSTM+RN+topic is slightly worse. But two channels of sentiment and topic couple well, achieving the best performance. This study shows the effectiveness of proposed model.