How did the discussion go: Discourse act classification in social media conversations
Table 4: Comparison with state-of-the-art model on Facebook data.
['Models', 'Precision', 'Recall', 'F1 score']
Now we move on to compare our best two models (CNN-LSTM and 2D LSTM, both with attention) with the state of the art CRF based model by Zhang et al. On the Reddit dataset, CRF model with only content features (with F1 score 0.50) was clearly outperformed by our models by big margin. However, the one with all the features still got better results compared to us, with F1 score 0.74. Though this test is not exhaustive with data from other discussion platforms, we can still conclude that our model achieved better domain independence.