X-SQL: reinforce schema representation with context
Table 1: Logical form (lf) and execution (ex) accuracy.
['Model', 'Dev Acclf', 'Dev Accex', 'Test Acclf', 'Test Accex']
We compare our results with the most recent work of WikiSQL leaderboard, including the previous state-of-the-art SQLova model. X-SQL is shown to be consistently and significantly better across all metrics and achieves the new state-of-the-art on both dev and test set. Without EG, X-SQL delivers an absolute 2.6% (83.3 vs. 80.7) improvement in logical form accuracy and 2.5% improvement in execution accuracy on test set. Even with EG, X-SQL is still 2.4% better in logical form accuracy, and 2.2% better in execution accuracy. It is worth noting that X-SQL+EG is the first model that surpasses the 90% accuracy on test set. On the other hand, for dev set human performance is estimated to be 88.2% according to Hwang et al. X-SQL is the first model better than human performance without the help of execution guidance.