Generative Stock Question Answering
Table 8: Performance of hybrid retrieval-generation model. “Generative” denotes the best generative model in the above section.
['[BOLD] Model', '[BOLD] w/ Number Perc.', '[BOLD] w/ Number Score', '[BOLD] w/o Number Perc.', '[BOLD] w/o Number Score', '[BOLD] All']
In this experiment, we investigate whether the improvement of hybrid model comes from better performance on number generation. To this end, we divide the generated answers into two parts by whether they refer to number generation. Concerning number generation, the hybrid model outperforms its sequential counterpart in terms of both quantity and quality, which validates our belief.