Modality-Agnostic Attention Fusion for visual search with text feedback
Table S4: Fashion IQ validation set Recall at 1, by rough classification of the types of modifier in the relative captions.
['[EMPTY]', 'all', 'color', 'texture', 'shape', 'parts', 'type']
To better understand the source of our model’s performance gains, we evaluated it on subsets of the Fashion IQ validation set that included keywords of several types, e.g., color (red, blue, green, …) and texture (stripe, solid, plaid, …). These modifier classes are not mutually exclusive since a caption like “is plaid blue and black” contains keywords for multiple modifier classes (in this case “plaid” texture and “blue and black” color). For all subsets, our model outperforms TIRG by roughly 16% relative on (R10 + R50)/2.