JEC-QA: A Legal-Domain Question Answering Dataset
Table 9: Performance of Co-matching with different K.
['[ITALIC] K=', '1', '3', '6', '12', '18', '24']
From the results, we can see that more reading paragraphs cannot help the models to answer the questions better, as important articles have already been fetched even K is small. It proves that the bad performance of models is because the insufficiency of reasoning ability rather than the quality of retrieval. As a larger value of K cannot help with the accuracy, we select K=6 to reach a balance of speed and performance.