Localizing Moments in Video with Temporal Language
Table 2: Word frequency of temporal words in natural language moment localization datasets.
['Dataset', 'Before', 'After', 'Then', 'While', 'Yet', 'During', 'Until']
Temporal Words in Current Datasets. We first analyze temporal words which occur in current natural language moment retrieval datasets. We consider temporal adjectives, adverbs, and prepositions found both by closely analyzing moment-localization datasets and consulting lists containing words which belong to different parts of speech. (TACoS Regneri et al. et al. , DiDeMo Hendricks et al. Though all moment localization datasets use temporal words, they do not contain enough examples to reliably train and evaluate current models. Additionally, we observe that temporal words which are frequently used when describing video segments are different than those commonly used in text without video grounding. Of temporal words, we focus on the four most common words, “before”, “after”, “then”, and “while” when creating our dataset.