The New Modality:Emoji Challenges in Prediction, Anticipation, and Retrieval
TABLE VI: Query-by-Emoji results for both supervised and zero-shot baselines. Results are reported in percentage mAP. In the supervised setting, we find the images to slightly outperform the text, but in the zero-shot setting the performance is reversed.
['[BOLD] Method', '[BOLD] Twemoji  [BOLD] (Full)', '[BOLD] Twemoji  [BOLD] (Balanced)', '[BOLD] Twemoji  [BOLD] (Images)']
Surprisingly, we see that retrieving tweets using only the supervised image understanding slightly outperforms both text-only and the fusion of the two. This result is markedly different from the emoji prediction task where text outperformed images. This could possibly be the result of a very strong correlation within high probability image-emoji pairs.