RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Table 5: RAT-SQL accuracy on WikiSQL, trained without BERT augmentation or execution-guided decoding (EG). Compared to other approaches without EG. “LF Acc” = Logical Form Accuracy; “Ex. Acc” = Execution Accuracy.
['[BOLD] Model', '[BOLD] Dev  [BOLD] LF Acc%', '[BOLD] Dev  [BOLD] Ex. Acc%', '[BOLD] Test  [BOLD] LF Acc%', '[BOLD] Test  [BOLD] Ex. Acc%']
Most of the gap between its accuracy and state of the art is due to the simplified implementation of value decoding, which is required for WikiSQL evaluation but not in Spider. Our value decoding for these experiments is a simple token-based pointer mechanism, which often fails to retrieve multi-token value constants accurately. A robust value decoding mechanism in RAT-SQL is an important extension that we plan to address outside the scope of this work.