Memeify: A Large-Scale Meme Generation System
Table 3. Average ratings of volunteers for original and generated memes (baseline and ours) across themes. ARO represents average ratings for original memes, ARG represents average ratings for generated memes (our model), and ARB represents average ratings for generated memes (baseline model).
['[BOLD] Theme', '[BOLD] ARO', '[BOLD] ARG', '[BOLD] ARB']
To evaluate user satisfaction levels, we conducted a rating study. We generated a batch of 100 memes for each theme by randomly picking classes within each theme, individually for the baseline model and our model. For each theme, we showed a set of 5 generated memes from our model, 5 generated memes from the baseline model, and 5 original memes, in a mixed order (without revealing the identity of the original and generated memes), to each volunteer. We asked them to rate the generated and original memes from a range of 1 (lowest rating) to 5 (highest rating) based on caption-content, humour and originality. We observe that the quality of our generated memes is almost on par with the original memes. We also notice that our model outperforms the baseline model, across all themes. Therefore, we maintain this on a holistic level; all of the volunteers were satisfied with the quality of the generated memes as well.