Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures
Table 2: Image datasets for the automatic description generation models. We have split the overview into image description datasets (top) and caption datasets (bottom) – see the main text for an explanation of this distinction.
['[EMPTY]', 'Images', 'Texts', 'Judgments', 'Objects']
There is a wide range of datasets for automatic image description research. The images in these datasets are associated with textual descriptions and differ from each other in certain aspects such as in size, the format of the descriptions and in how the descriptions were collected. Here we review common approaches for collecting datasets, the datasets themselves, and evaluation measures for comparing generated descriptions with ground-truth texts. The readers can also refer to the dataset survey by \citeAFerraro2015 for an analysis similar to ours. It provides a basic comparison of some of the existing language and vision datasets. It is not limited to automatic image description, and it reports some simple statistics and quality metrics such as perplexity, syntactic complexity, and abstract to concrete word ratios.