Rapid Classification of Crisis-Related Data on Social Networks usingConvolutional Neural Networks
TABLE IV: The accuracy scores of the SVM and CNN based methods with different data settings.
['SYS', 'SVM Accuracy', 'CNN [ITALIC] I Accuracy', 'MLP-CNN [ITALIC] I Accuracy', 'SVM Macro F1', 'CNN [ITALIC] I Macro F1', 'MLP-CNN [ITALIC] I Macro F1']
Similar to the results of the binary classification task, the CNN model outperformed the SVM model in all data settings. Combining MLP and CNN improved the performance of our system significantly. The results on training with both event and out-of-event data did not have a clear improvement over training on the event data only. The results dropped slightly in some cases.