How Can We Know What Language Models Know?
Table 10: Micro-averaged accuracy (%) on Google-RE.
['[BOLD] Model', '[BOLD] Man', '[BOLD] Mine', '[BOLD] Mine  [BOLD] +Man', '[BOLD] Mine  [BOLD] +Para', '[BOLD] Man  [BOLD] +Para']
Again, ensembling diverse prompts improves accuracies for both the BERT-base and BERT-large models. The gains are somewhat smaller than those on the T-REx subset, which might be caused by the fact that there are only 3 relations and one of them (predicting the birth-date of a person) is particularly hard to the extent that only one prompt yields non-zero accuracy.