SParC: Cross-Domain Semantic Parsing in Context
Table 6: Performance of various methods over all questions (question match) and all interactions (interaction match).
['Model', 'Question Match', 'Question Match', 'Interaction Match', 'Interaction Match']
The context-aware models (CD-Seq2Seq and SyntaxSQL-con) significantly outperforms the context-agnostic SyntaxSQLNet (SyntaxSQL-sta). The last two rows form a controlled ablation study, where without accessing to the previous question, the test set performance of SyntaxSQLNet decreases from 20.2% to 16.9% on question match and from 5.2% to 1.1% on interaction match, which indicates that context is a crucial aspect of the problem.