REVIEW 6 cited by
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
When translating natural language questions into SQL queries to answer questions from a database, contemporary semantic parsing models struggle to generalize to unseen database schemas. The generalization challenge lies in (a) encoding the database relations in an accessible way for the semantic parser, and (b) modeling alignment between database columns and their mentions in a given query. We present a unified framework, based on the relation-aware self-attention mechanism, to address schema encoding, schema linking, and feature representation within a text-to-SQL encoder. On the challenging Spider dataset this framework boosts the exact match accuracy to 57.2%, surpassing its best counterparts by 8.7% absolute improvement. Further augmented with BERT, it achieves the new state-of-the-art performance of 65.6% on the Spider leaderboard. In addition, we observe qualitative improvements in the model's understanding of schema linking and alignment. Our implementation will be open-sourced at https://github.com/Microsoft/rat-sql.
Forward citations
Cited by 6 Pith papers
-
TailorSQL: An NL2SQL System Tailored to Your Query Workload
Adding workload-derived hints and tailored retrieval from past SQL queries improves NL2SQL execution accuracy and reduces prompt size on three benchmarks.
-
ODIN: A NL2SQL Recommender to Handle Schema Ambiguity
ODIN uses schema masking, conformal-prediction filtering, and user-preference hints to return a small set of SQL queries that includes the correct one more often than baseline sampling on ambiguous-schema benchmarks.
-
PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning
PaVeRL-SQL reports SOTA execution accuracy on Spider2.0-SQLite using partial-match rewards and verbal RL, but overclaims SOTA on Spider and BIRD.
-
Confidence Estimation for Text-to-SQL in Large Language Models
Consistency-based methods are the most reliable confidence signal for text-to-SQL in black-box LLMs, and executing queries against a database adds a useful correctness signal.
-
Interactive Text-to-SQL via Expected Information Gain for Disambiguation
An interactive text-to-SQL framework selects clarification questions by expected information gain over a distribution of candidate SQL queries.
-
eSapiens: A Real-World NLP Framework for Multimodal Document Understanding and Enterprise Knowledge Processing
eSapiens combines text-to-SQL and hybrid retrieval-augmented generation with citation verification, and its evaluation on RAGTruth shows better contextual relevance than a FAISS baseline across most LLMs, at the cost ...
Discussion (0). Continue with ORCID to comment.