Paper Citation Record · LEDGER

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations

As of 10 August 2026, this Paper Citation Record lists 48 of 48 outbound references and 2 inbound Pith citation observations for arXiv:2501.18197.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.18197 v1

Coverage vector

measured 48 of 48 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T00:23:35.148602Z

measured 50 of 50 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:48:30.522136Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T15:56:35.789168Z

Reference resolution

48 of 48 outbound references displayed

verified exact1
verified fuzzy3
unresolved44
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 5a9656e0-69f7-4bf1-bd06-15e0ebc49b0c · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.575245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 51654d81-f87d-46b1-a2b3-514ab7bfbe27 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.542767Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 76211c9a-2c29-42af-8118-66de70e1d450 · outbound

This paper cites ETM: Modern Insights into Perspective on Text-to-SQL Evaluation in the Age of Large Language Models.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations ETM: Modern Insights into Perspective on Text-to-SQL Evaluation in the Age of Large Language Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.222734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b11c130a-5c23-4fe6-9c3c-cfbc9c76641f · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.522511Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f33fa519-60ed-4401-b22e-5a6725b63d25 · outbound

This paper cites FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledge.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledge

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.239555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7470d0ed-2286-4b3d-babc-b6f627b4e5f2 · outbound

This paper cites Eureka: Evaluating and Understanding Large Foundation Models.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Eureka: Evaluating and Understanding Large Foundation Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.233807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3904a77f-9155-470e-8223-40c800767b04 · outbound

This paper cites Text2SQL is Not Enough: Unifying AI and Databases with TAG.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Text2SQL is Not Enough: Unifying AI and Databases with TAG

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.250623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c278bcf3-0431-4579-a556-119ad5e08b57 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.503405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5d31aab5-6f10-4ad2-bb42-502448c93768 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.218452Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation bb8b8aa6-900c-40c0-925a-76c149aff362 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.487029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 00620c59-386f-49ac-acd1-2f711b9a184a · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.380057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 482355ac-9a6b-4dc0-91f3-667f166c124e · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.430423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bbfae4d1-5500-4c82-bd6f-fc411e03587a · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.180106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 96dd7cc2-c86b-47d8-aa5e-02dc97578f2d · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.107997Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4a818d26-fbce-47f9-83fe-95d1984d21a7 · outbound

This paper cites Model Patching: Closing the Subgroup Performance Gap with Data Augmentation.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Model Patching: Closing the Subgroup Performance Gap with Data Augmentation

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.675032Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b48135b8-f454-4b96-b7aa-fb7cc848bf58 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.143803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d70035dc-bdab-4943-8cdc-14fbe6492887 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.126850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 0e077318-41ec-40e4-af4c-0e7d3d2240f2 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.776793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 314bb9da-335b-4e90-b297-b4e25e40bcdc · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.604377Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1262106b-7096-45b5-a23f-fdfc461208af · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.091702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7317ca30-1645-4069-b262-8aa095fb825d · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:37.008417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a4cca4e6-213c-4971-9fa4-8b4f1d74cda1 · outbound

This paper cites Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarks

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.771117Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec1d6081-38d1-48c0-b44c-c98c155f8582 · outbound

This paper cites Semantic Operators: A Declarative Model for Rich, AI-based Data Processing.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Semantic Operators: A Declarative Model for Rich, AI-based Data Processing

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.776004Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9c6bd43-fe81-4024-bff3-5f37a9927a7c · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.760442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae77e7a4-0945-4dfc-9778-6d7fae302240 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.577489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6e43533d-2874-4875-98ee-1d93591427c3 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.549147Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 12782040-f1bf-472c-906a-e3429d2c4352 · outbound

This paper cites A Survey of Hallucination in Large Foundation Models.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations A Survey of Hallucination in Large Foundation Models

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.795131Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e315216d-221e-4553-8eee-dbf6e85a2931 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.781684Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d38d2c7-1697-4661-9b5e-cbde4ece1064 · outbound

This paper cites Evaluating the Text-to-SQL Capabilities of Large Language Models.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Evaluating the Text-to-SQL Capabilities of Large Language Models

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.785840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 84998e73-8d8f-448c-9efb-c376ab082d57 · outbound

This paper cites A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.809850Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 194727ea-689d-443b-9ec7-dc5ce4b3a9ad · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.515642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4a6c1174-3664-47d4-a2b5-a0ad5e210788 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.533487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1cd0c4db-5f75-46ed-a939-cf8c3e1df674 · outbound

This paper cites Evaluating Bayes Error Estimators on Real-World Datasets with FeeBee.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Evaluating Bayes Error Estimators on Real-World Datasets with FeeBee

Reference 33

Resolution: verified exact; local_arxiv, observed 2026-08-10T00:23:35.450595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2dbfc930-0e65-408b-a493-5fa0f0162ad6 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.828499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e598a75a-4b9a-4849-8c39-ba987003a7dd · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 35

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.028142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ef58c7f9-f606-491b-a39e-c1e0ae4cb7c8 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.341238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 279154ee-138a-43c0-957f-f460810a133f · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 37

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.140022Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 761fef36-b5c5-4b7e-8b1f-71e8a30016a0 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:35.988189Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 62448a27-c995-4b0b-b8ef-742e14a54878 · outbound

This paper cites LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.854769Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be6c2271-1612-4478-8b5d-97532cfa7c60 · outbound

This paper cites STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.837131Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a51957ef-2592-4ed7-af6e-65131fde0de1 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 41

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:36.009405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 163c1ba0-42f0-4b5b-b260-7c0201985a46 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-10T00:23:34.845988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23ede777-486c-48a5-9dfc-05a4dda3a3d6 · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 45

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:35.970698Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a038dc3c-f8ee-492d-90cf-8ea03c43e95e · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 46

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:35.954256Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 27403971-6092-45d3-b1f3-ff2c274a561a · outbound

This paper cites an unresolved cited work.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations Unresolved cited work

Reference 47

Resolution: unresolved; raw_fallback, observed 2026-08-10T00:23:35.884146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 9064acb3-4e07-4575-af48-48a6c2fa5cb1 · outbound

This paper cites { NL_DESCRIPTION }.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations { NL_DESCRIPTION }

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T00:23:35.707883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4d52847d-8954-41c7-b9f7-c2ab77f797ce · outbound

This paper cites In The Eleventh International Conference on Learning Representations.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations In The Eleventh International Conference on Learning Representations

Reference 2023

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T00:23:37.337858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 64c3bd00-61c3-4702-b5c7-cd4f03b89af0 · outbound

This paper cites arXiv e-prints (2024), arXiv–2406.

Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations arXiv e-prints (2024), arXiv–2406

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-10T00:23:37.559320Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Pith citing papers

Observation 74a2f3c1-c7d1-4bc6-9fac-003778be3ee0 · inbound

PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning cites this paper.

PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-04T22:48:30.522136Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 98c949f7-8f78-4633-8143-2a17c065cdf4 · inbound

EGREFINE: An Execution-Grounded Optimization Framework for Text-to-SQL Schema Refinement cites this paper.

EGREFINE: An Execution-Grounded Optimization Framework for Text-to-SQL Schema Refinement Fundamental Challenges in Evaluating Text2SQL Solutions and Detecting Their Limitations

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-11T15:56:35.848349Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.