iSarcasm: A Dataset of Intended Sarcasm
Table 7: Experimental results on iSarcasm. Manual Labelling shows the results using the perceived sarcasm labels provided by third-party human annotators.
['[BOLD] Model', 'Precision', 'Recall', 'F-score']
As shown, all the models perform significantly worse than humans, who achieve an F-score of only 0.616. MIARN is the best performing model with a considerably low F-score of 0.364, compared to its performance on the Riloff and Ptacek datasets (0.741 and 0.874 F-scores respectively). 3CNN achieves the lowest performance on iSarcasm with an F-Score of 0.286 compared to 0.675 and 0.788 on SARC balanced and imbalanced, respectively. Similarly, Dense-LSTM achieves 0.318, compared to 0.666 on SemEval-2018.