REVIEW 7 cited by
Table-GPT: Table-tuned GPT for Diverse Table Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Language models, such as GPT-3.5 and ChatGPT, demonstrate remarkable abilities to follow diverse human instructions and perform a wide range of tasks. However, when probing language models using a range of basic table-understanding tasks, we observe that today's language models are still sub-optimal in many table-related tasks, likely because they are pre-trained predominantly on \emph{one-dimensional} natural-language texts, whereas relational tables are \emph{two-dimensional} objects. In this work, we propose a new "\emph{table-tuning}" paradigm, where we continue to train/fine-tune language models like GPT-3.5 and ChatGPT, using diverse table-tasks synthesized from real tables as training data, with the goal of enhancing language models' ability to understand tables and perform table tasks. We show that our resulting Table-GPT models demonstrate (1) better \emph{table-understanding} capabilities, by consistently outperforming the vanilla GPT-3.5 and ChatGPT, on a wide-range of table tasks, including holdout unseen tasks, and (2) strong \emph{generalizability}, in its ability to respond to diverse human instructions to perform new table-tasks, in a manner similar to GPT-3.5 and ChatGPT.
Forward citations
Cited by 7 Pith papers
-
Utilizing Training Data to Improve LLM Reasoning for Tabular Understanding
LRTab retrieves error-avoiding prompt conditions learned from incorrect chain-of-thought traces on training tables to improve LLM tabular reasoning, achieving modest gains on WikiTQ and TabFact.
-
Table-r1: Self-supervised and Reinforcement Learning for Program-based Table Reasoning in Small Language Models
Table-r1 combines a layout-transformation self-supervised task and a mix-paradigm GRPO stage so 7B/8B models outperform other small-model table reasoners and approach GPT-4o-level accuracy.
-
FlowETL: An Autonomous Example-Driven Pipeline for Data Engineering
FlowETL uses LLMs and a small target dataset to automatically infer and apply data-cleaning transformations, reporting high data-quality scores across 14 datasets.
-
QUEST: Query Optimization in Unstructured Document Analysis
QUEST reduces LLM extraction cost in unstructured document analytics by retrieving only relevant segments via a two-level index and by generating per-document filter and join execution plans during query execution.
-
Improving Large Language Models with Concept-Aware Fine-Tuning
Adding lightweight multi-token auxiliary heads with a weighted future-token loss improves supervised fine-tuning of Llama-3-8B-Instruct across five diverse tasks.
-
Relationship Detection on Tabular Data Using Statistical Analysis and Large Language Models
A domain-and-type-filtered LLM pipeline reaches competitive Column Property Annotation scores on SemTab 2023 SOTAB without fine-tuning, while co-appearance-based filtering consistently hurts accuracy.
-
An Empirical study on LLM-based Log Retrieval for Software Engineering Metadata Management
A natural-language log retrieval pipeline using LLM-generated video and signal descriptions shows that prompt and model choice matter, but its proposed reliability metrics are not validated against any ground truth.
Discussion (0). Continue with ORCID to comment.