Incremental Improvement of a Question Answering System by Re-ranking Answer Candidates using Machine Learning
Table 3: Performance metrics of the baseline QA pipeline and our re-ranking method (n=3084).
['[BOLD] Metric', '[BOLD] Method  [ITALIC] Baseline QA', '[BOLD] Method  [ITALIC] Re-Ranking', '[BOLD] Relative  [BOLD] Improvement']
\runinhead Results. The relative improvement decreases from 14.83% for the top-1 accuracy to 1.68% for the top-9 accuracy. The top-10 accuracy stays constant, because the re-ranking cannot choose from outside the top-10 candidates. The MRR improves from 0.296 to 0.323 (9.15%).