Olive Oil is Made of Olives, Baby Oil is Made for Babies:Interpreting Noun Compounds using Paraphrases in a Neural Model
Table 2: Number of instances in each dataset split.
['[BOLD] Dataset', '[BOLD] Split', '[BOLD] Train', '[BOLD] Validation', '[BOLD] Test']
To better test this hypothesis, we evaluate on 4 different splits of the datasets to train, test, and validation sets: (1) random, in a 75:20:5 ratio, (2) lexical-full, in which the train, test, and validation sets each consists of a distinct vocabulary. The split was suggested by \newcitelevy-EtAl:2015:NAACL-HLT, and it randomly assigns words to distinct sets, such that for example, including travel guide in the train set promises that fishing guide would not be included in the test set, and the models do not benefit from memorizing that the head guide is always annotated as topic. Given that the split discards many NCs, we experimented with two additional splits: (3) lexical-mod split, in which the w1 words are unique in each set, and (4) lexical-head split, in which the w2 words are unique in each set.