A Question-Entailment Approach to Question Answering
Table 6: LiveQA Measures: Average Score (main score), Success@i+ and Precision@i+ on LiveQA’17 Test Data. Evaluation of the first retrieved answer for each question. N.B. Evaluating the RQE System alone is not relevant as explained previously (Section 5.1).
['[BOLD] Measures', '[BOLD] IR-based System', '[BOLD] IR+RQE System', '[BOLD] LiveQA’17 Best Results', '[BOLD] LiveQA’17 Median Results']
The hybrid IR+RQE QA system achieved better results than the IR-based system with 0.827 average score. It also achieved a higher score than the best results achieved in the medical challenge at LiveQA’17. Evaluating the RQE system alone is not relevant, as applying RQE on the full collection for each user question is not feasible for a real-time system because of the extended execution time.