REVIEW 22 cited by
C3: Zero-shot Text-to-SQL with ChatGPT
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This paper proposes a ChatGPT-based zero-shot Text-to-SQL method, dubbed C3, which achieves 82.3\% in terms of execution accuracy on the holdout test set of Spider and becomes the state-of-the-art zero-shot Text-to-SQL method on the Spider Challenge. C3 consists of three key components: Clear Prompting (CP), Calibration with Hints (CH), and Consistent Output (CO), which are corresponding to the model input, model bias and model output respectively. It provides a systematic treatment for zero-shot Text-to-SQL. Extensive experiments have been conducted to verify the effectiveness and efficiency of our proposed method.
Forward citations
Cited by 22 Pith papers
-
Text-to-SQL Oriented to the Process Mining Domain: A PT-EN Dataset for Query Translation
text-2-SQL-4-PM is a bilingual benchmark with 1,655 human utterances and 205 gold SQL statements for text-to-SQL in process mining.
-
EvoSQL: Memory-Augmented Critic-Generator Co-Evolution for Text-to-SQL
A generator-critic co-evolution loop with per-question memory lifts Text-to-SQL execution accuracy by up to +9.19 points over majority-vote baselines on Spider and BIRD.
-
ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
A fine-tuned model with special error tokens detects SQL mistakes and guides LLMs to fix them, raising execution accuracy on BIRD from 55.87% to 66.23% and on Spider from 75.44% to 86.94% over GPT-4o.
-
SEED: Enhancing Text-to-SQL Performance and Practical Usability Through Automatic Evidence Generation
SEED automatically generates evidence from database schemas, descriptions, and sampled values, improving text-to-SQL accuracy in no-evidence settings.
-
RAISE: Reasoning Agent for Interactive SQL Exploration
An interactive reasoning agent that explores databases with live queries raises text-to-SQL execution accuracy from 44.8% to 56.5% and achieves 81.8% best-of-N coverage on BIRD.
-
Knowledge Base Construction for Knowledge-Augmented Text-to-SQL
KAT-SQL constructs a reusable knowledge base for text-to-SQL by expanding training data with LLM-generated knowledge and retrieving/refining the best entries for each query.
-
Automatic Metadata Extraction for Text-to-SQL
LLM-generated summaries of database profiling statistics outperform human-written metadata for text-to-SQL on BIRD, and a SQL-generation-based schema linker adds further gains.
-
ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects
Execution-driven bootstrapping, where a model generates SQL, executes it, and keeps only queries that run, lets a 7B model outperform GPT-4o on PostgreSQL, MySQL, and Oracle text-to-SQL benchmarks.
-
Learning When to Reason for Text-to-SQL via SFT and DPO
A training pipeline that teaches a text-to-SQL model to skip chain-of-thought reasoning on easy queries preserves accuracy while reducing inference tokens and latency.
-
Schema-Aware Localisation (SAL): Live Schema Grounding and Hallucination Validation for Oracle NL2SQL
Live schema grounding against Oracle's catalog plus alias/column validation lifts execution-grounded NL2SQL correctness from 2.2% to 62.6% on 500 TPC-H questions.
-
APEX-SQL: Talking to the data via Agentic Exploration for Text-to-SQL
An agentic text-to-SQL pipeline using hypothesis-verification exploration achieves 70.7% execution accuracy on BIRD-Dev and 51.0% on Spider 2.0-Snow.
-
Pi-SQL: Enhancing Text-to-SQL with Fine-Grained Guidance from Pivot Programming Languages
Generating Python programs as intermediate guidance before SQL, then voting on Python execution results to select the fastest matching SQL, improves text-to-SQL execution accuracy and efficiency on BIRD and Archer.
-
Effectiveness of Prompt Optimization in NL2SQL Systems
Iterative prompt optimization with an LLM proposer improves NL2SQL accuracy and prompt compactness on BIRD dev, and a latency-aware variant reduces worst-case SQL execution time.
-
CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process
CHS-SQL combines beam search with model-internal-confidence filtering in schema linking to improve small-model text-to-SQL accuracy on Spider and BIRD.
-
Text to Query Plans for Question Answering on Large Tables
A ReAct-style LLM agent converts natural-language questions into query plans over DataFrame operators, using a three-level column-cluster-table vector index to handle tables with over 8,000 columns.
-
Confidence Estimation for Text-to-SQL in Large Language Models
Consistency-based methods are the most reliable confidence signal for text-to-SQL in black-box LLMs, and executing queries against a database adds a useful correctness signal.
-
SLM-SQL: An Exploration of Small Language Models for Text-to-SQL
A post-training pipeline combining SFT, GRPO reinforcement learning, and corrective self-consistency lifts 0.5B-1.5B models to 56.9%-67.1% execution accuracy on BIRD dev.
-
SQLord: A Robust Enterprise Text-to-SQL Solution via Reverse Data Generation and Workflow Decomposition
SQLord builds a domain-specific text-to-SQL pipeline using reverse-generated query-SQL training pairs, workflow decomposition, and an LLM-based judge, reporting consistent gains over GPT-4 and open-source baselines.
-
Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Task
Schema-R1 combines cold-start SFT on 200 CoT samples with GRPO rule-based RL, reporting table and column filter accuracy gains of 10 percentage points or more over a fine-tuned baseline on Spider-dev.
-
Exploring the Landscape of Text-to-SQL with Large Language Models: Progresses, Challenges and Opportunities
A systematic review organizing LLM-based text-to-SQL methods into pre-processing, in-context learning, fine-tuning, and post-processing paradigms, with a catalog of datasets, metrics, challenges, and future directions.
-
eSapiens: A Real-World NLP Framework for Multimodal Document Understanding and Enterprise Knowledge Processing
eSapiens combines text-to-SQL and hybrid retrieval-augmented generation with citation verification, and its evaluation on RAGTruth shows better contextual relevance than a FAISS baseline across most LLMs, at the cost ...
-
Auto prompt sql: a resource-efficient architecture for text-to-sql translation in constrained environments
AP-SQL combines schema filtering, retrieval-augmented generation, and reasoning prompts, reporting small accuracy gains on the Spider text-to-SQL benchmark.
Discussion (0). Sign in to comment.