Pith. sign in

REVIEW 22 cited by

C3: Zero-shot Text-to-SQL with ChatGPT

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2307.07306 v1 pith:CGYV3CD7 submitted 2023-07-14 cs.CL cs.AI

classification cs.CLcs.AI
keywords text-to-sqlzero-shotmethodmodeloutputspideraccuracyachieves
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This paper proposes a ChatGPT-based zero-shot Text-to-SQL method, dubbed C3, which achieves 82.3\% in terms of execution accuracy on the holdout test set of Spider and becomes the state-of-the-art zero-shot Text-to-SQL method on the Spider Challenge. C3 consists of three key components: Clear Prompting (CP), Calibration with Hints (CH), and Consistent Output (CO), which are corresponding to the model input, model bias and model output respectively. It provides a systematic treatment for zero-shot Text-to-SQL. Extensive experiments have been conducted to verify the effectiveness and efficiency of our proposed method.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 22 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 28 citations worldwide. Full citation record

  1. Text-to-SQL Oriented to the Process Mining Domain: A PT-EN Dataset for Query Translation

    cs.IR 2025-08 conditional novelty 7.0 of 10

    text-2-SQL-4-PM is a bilingual benchmark with 1,655 human utterances and 205 gold SQL statements for text-to-SQL in process mining.

  2. EvoSQL: Memory-Augmented Critic-Generator Co-Evolution for Text-to-SQL

    cs.AI 2026-06 conditional novelty 6.0 of 10

    A generator-critic co-evolution loop with per-question memory lifts Text-to-SQL execution accuracy by up to +9.19 points over majority-vote baselines on Spider and BIRD.

  3. ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement

    cs.CL 2026-03 conditional novelty 6.0 of 10

    A fine-tuned model with special error tokens detects SQL mistakes and guides LLMs to fix them, raising execution accuracy on BIRD from 55.87% to 66.23% and on Spider from 75.44% to 86.94% over GPT-4o.

  4. SEED: Enhancing Text-to-SQL Performance and Practical Usability Through Automatic Evidence Generation

    cs.CL 2025-06 conditional novelty 6.0 of 10

    SEED automatically generates evidence from database schemas, descriptions, and sampled values, improving text-to-SQL accuracy in no-evidence settings.

  5. RAISE: Reasoning Agent for Interactive SQL Exploration

    cs.AI 2025-06 conditional novelty 6.0 of 10

    An interactive reasoning agent that explores databases with live queries raises text-to-SQL execution accuracy from 44.8% to 56.5% and achieves 81.8% best-of-N coverage on BIRD.

  6. Knowledge Base Construction for Knowledge-Augmented Text-to-SQL

    cs.CL 2025-05 conditional novelty 6.0 of 10

    KAT-SQL constructs a reusable knowledge base for text-to-SQL by expanding training data with LLM-generated knowledge and retrieving/refining the best entries for each query.

  7. Automatic Metadata Extraction for Text-to-SQL

    cs.DB 2025-05 conditional novelty 6.0 of 10

    LLM-generated summaries of database profiling statistics outperform human-written metadata for text-to-SQL on BIRD, and a SQL-generation-based schema linker adds further gains.

  8. ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Execution-driven bootstrapping, where a model generates SQL, executes it, and keeps only queries that run, lets a 7B model outperform GPT-4o on PostgreSQL, MySQL, and Oracle text-to-SQL benchmarks.

  9. Learning When to Reason for Text-to-SQL via SFT and DPO

    cs.CL 2026-06 conditional novelty 5.0 of 10

    A training pipeline that teaches a text-to-SQL model to skip chain-of-thought reasoning on easy queries preserves accuracy while reducing inference tokens and latency.

  10. Schema-Aware Localisation (SAL): Live Schema Grounding and Hallucination Validation for Oracle NL2SQL

    cs.AI 2026-06 conditional novelty 5.0 of 10

    Live schema grounding against Oracle's catalog plus alias/column validation lifts execution-grounded NL2SQL correctness from 2.2% to 62.6% on 500 TPC-H questions.

  11. APEX-SQL: Talking to the data via Agentic Exploration for Text-to-SQL

    cs.DB 2026-02 conditional novelty 5.0 of 10

    An agentic text-to-SQL pipeline using hypothesis-verification exploration achieves 70.7% execution accuracy on BIRD-Dev and 51.0% on Spider 2.0-Snow.

  12. Pi-SQL: Enhancing Text-to-SQL with Fine-Grained Guidance from Pivot Programming Languages

    cs.CL 2025-06 conditional novelty 5.0 of 10

    Generating Python programs as intermediate guidance before SQL, then voting on Python execution results to select the fastest matching SQL, improves text-to-SQL execution accuracy and efficiency on BIRD and Archer.

  13. Effectiveness of Prompt Optimization in NL2SQL Systems

    cs.CL 2025-05 conditional novelty 5.0 of 10

    Iterative prompt optimization with an LLM proposer improves NL2SQL accuracy and prompt compactness on BIRD dev, and a latency-aware variant reduces worst-case SQL execution time.

  14. CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking process

    cs.AI 2026-06 conditional novelty 4.0 of 10

    CHS-SQL combines beam search with model-internal-confidence filtering in schema linking to improve small-model text-to-SQL accuracy on Spider and BIRD.

  15. Text to Query Plans for Question Answering on Large Tables

    cs.DB 2025-08 conditional novelty 4.0 of 10

    A ReAct-style LLM agent converts natural-language questions into query plans over DataFrame operators, using a three-level column-cluster-table vector index to handle tables with over 8,000 columns.

  16. Confidence Estimation for Text-to-SQL in Large Language Models

    cs.CL 2025-08 unverdicted novelty 4.0 of 10

    Consistency-based methods are the most reliable confidence signal for text-to-SQL in black-box LLMs, and executing queries against a database adds a useful correctness signal.

  17. SLM-SQL: An Exploration of Small Language Models for Text-to-SQL

    cs.CL 2025-07 conditional novelty 4.0 of 10

    A post-training pipeline combining SFT, GRPO reinforcement learning, and corrective self-consistency lifts 0.5B-1.5B models to 56.9%-67.1% execution accuracy on BIRD dev.

  18. SQLord: A Robust Enterprise Text-to-SQL Solution via Reverse Data Generation and Workflow Decomposition

    cs.DB 2025-07 unverdicted novelty 4.0 of 10

    SQLord builds a domain-specific text-to-SQL pipeline using reverse-generated query-SQL training pairs, workflow decomposition, and an LLM-based judge, reporting consistent gains over GPT-4 and open-source baselines.

  19. Schema-R1: A reasoning training approach for schema linking in Text-to-SQL Task

    cs.AI 2025-06 conditional novelty 4.0 of 10

    Schema-R1 combines cold-start SFT on 200 CoT samples with GRPO rule-based RL, reporting table and column filter accuracy gains of 10 percentage points or more over a fine-tuned baseline on Spider-dev.

  20. Exploring the Landscape of Text-to-SQL with Large Language Models: Progresses, Challenges and Opportunities

    cs.CL 2025-05 conditional novelty 4.0 of 10

    A systematic review organizing LLM-based text-to-SQL methods into pre-processing, in-context learning, fine-tuning, and post-processing paradigms, with a catalog of datasets, metrics, challenges, and future directions.

  21. eSapiens: A Real-World NLP Framework for Multimodal Document Understanding and Enterprise Knowledge Processing

    cs.IR 2025-06 conditional novelty 3.0 of 10

    eSapiens combines text-to-SQL and hybrid retrieval-augmented generation with citation verification, and its evaluation on RAGTruth shows better contextual relevance than a FAISS baseline across most LLMs, at the cost ...

  22. Auto prompt sql: a resource-efficient architecture for text-to-sql translation in constrained environments

    cs.CL 2025-06 reject novelty 3.0 of 10

    AP-SQL combines schema filtering, retrieval-augmented generation, and reasoning prompts, reporting small accuracy gains on the Spider text-to-SQL benchmark.

Pith tools