Are Emojis Predictable?
Table 4: Precision, Recall and F-Measure of human evaluation and the character-based B-LSTM for the 5 most frequent emojis and 1,000 tweets.
['[BOLD] Emo', '[BOLD] Humans  [BOLD] P', '[BOLD] Humans  [BOLD] R', '[BOLD] Humans  [BOLD] F1', '[BOLD] B-LSTM  [BOLD] P', '[BOLD] B-LSTM  [BOLD] R', '[BOLD] B-LSTM  [BOLD] F1']
The emojis that the char-BLSTM struggle to predict are and , while the human annotators mispredict and mostly. An interesting result is the number of times was chosen by human annotators; this emoji occurred 100 times (by chance) in the test set, but it was chosen 208 times, mostly when the correct label was the laughing emoji . We do not observe the same behavior in the char-BLSTMs, perhaps because they encoded information about the probability of these two emojis and when in doubt, the laughing emoji was chosen as more probable.