Improving Segmentation for Technical Support Problems
Table 5: Retrieval results, comparing the performance of querying with the full question against segmented question (gold segments and predicted segments)
['[BOLD] Method', '[BOLD] MRR']
We show that weighing identified segments of the question with separate weights improves retrieval of the correct answer over a query with all tokens from the question. We also present results from the gold annotations of segments for these questions, as an upper-bound of the performance improvement we can hope to achieve.