How Can We Know What Language Models Know?
Table 7: Ablation study of middle-word and dependency-based prompts on BERT-base.
['[BOLD] Prompts', '[BOLD] Top1', '[BOLD] Top3', '[BOLD] Top5', '[BOLD] Opti.', '[BOLD] Oracle']
Middle-word vs. Dependency-based The improvements confirm our intuition that words belonging to the dependency path but not in the middle of the subject and object are also indicative of the relation.