ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
Table 4. Space Footprint vs MRR@10 (Dev) on MS MARCO.
['Setting', 'Dimension( [ITALIC] m)', 'Bytes/Dim', 'Space(GiBs)', 'MRR@10']
Interestingly, the most space-efficient setting, that is, re-ranking with cosine similarity with 24-dimensional vectors stored as 2-byte floats, is only 1% worse in MRR@10 than the most space-consuming one, while the former requires only 27 GiBs to represent the MS MARCO collection.