Poly-encoders: architectures and pre-training strategies for fast and accurate multi-sentence scoring
Table 6: Training time in hours.
['Dataset', 'ConvAI2', 'DSTC7', 'UbuntuV2']
Poly-encoders also have the benefit of being 3-4x faster to train than Cross-encoders (and are similar in training time to Bi-encoders).