BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA
Table 1: Mean precision at one (P@1) for LAMA and LAMA-UHN on the TREx and GooglRE subsets.
['Corpus', 'BERT-base', 'BERT-large', 'BERT-kNN']
BERT-kNN outperforms BERT on the LAMA dataset. It obtains over 10 precision points gain over BERT-base and large. Note that our model uses BERT-base only.