Expect the unexpected: Harnessing Sentence Completion for Sarcasm Detection
TABLE V: Performance of the all-words approach versus the situation when the exact incongruous word is known
['[BOLD] Approach', '[BOLD] T', '[BOLD] P', '[BOLD] R', '[BOLD] F']
Since our approaches perform well for short text like tweets but not for long text such as discussion forum posts, choosing the right set of candidate positions appears to be crucial for the success of the proposed technique. The Incongruous words-only is a step in that direction, but we observe that it is not sufficient in case of discussion forum posts. Hence, in this section, we consider an oracle case: the exact incongruous word case. This is the case where the exact incongruous word is known. Hence, we now compare our all-words approach with an ‘exact incongruous word’ approach, when the exact incongruous word is known. In this case, we do not iterate over all word positions but only the position of the incongruous word. Their dataset consists of a word, a tweet containing the word and the sarcastic/non-sarcastic label. In case of sarcastic tweets, the word indicates the specific incongruous word. We observe that the F-score increases from 55.43% to 63.42% when the exact incongruous word is known. This shows that our approaches can be refined further to be able to zone in on a smaller set of candidate incongruous words.