REVIEW 16 cited by
Language Models are Realistic Tabular Data Generators
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Tabular data is among the oldest and most ubiquitous forms of data. However, the generation of synthetic samples with the original data's characteristics remains a significant challenge for tabular data. While many generative models from the computer vision domain, such as variational autoencoders or generative adversarial networks, have been adapted for tabular data generation, less research has been directed towards recent transformer-based large language models (LLMs), which are also generative in nature. To this end, we propose GReaT (Generation of Realistic Tabular data), which exploits an auto-regressive generative LLM to sample synthetic and yet highly realistic tabular data. Furthermore, GReaT can model tabular data distributions by conditioning on any subset of features; the remaining features are sampled without additional overhead. We demonstrate the effectiveness of the proposed approach in a series of experiments that quantify the validity and quality of the produced data samples from multiple angles. We find that GReaT maintains state-of-the-art performance across numerous real-world and synthetic data sets with heterogeneous feature types coming in various sizes.
Forward citations
Cited by 16 Pith papers
-
FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents
FairDiffuseVQVAE reaches state-of-the-art fairness on the standard tabular benchmark (DPR 0.702, EOR 0.686) by uniform protected-attribute sampling at inference, paying ~15 AUC points of utility.
-
From Noise to Order: Learning to Rank via Denoising Diffusion
DiffusionRank, a diffusion-based generative model over feature-label tuples, improves learning-to-rank over discriminative baselines on MQ2007 and MSLR-WEB10K, but not consistently on MQ2008.
-
TAGAL: Tabular Data Generation using Agentic LLM Methods
TAGAL uses an agentic LLM loop, generation plus feedback, to produce synthetic tabular data without LLM training, matching trained models on some datasets and beating the training-free EPIC baseline.
-
Ensembling Membership Inference Attacks Against Tabular Generative Models
No single membership inference attack dominates across tabular generative models, and unsupervised ensembles of attacks achieve better average rankings.
-
Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches
Serialization format and in-context examples change both accuracy and gender fairness of LLM loan approvals, with finance-tuned models often showing larger disparities.
-
Meta-learning ecological priors from large language models explains human learning and decision making
A meta-learned transformer trained on LLM-generated tasks (ERMI) outperforms classical cognitive models in predicting human choices across function learning, category learning, and decision making.
-
Tab-MIA: A Benchmark Dataset for Membership Inference Attacks on Tabular Data in LLMs
Tab-MIA shows LLMs fine-tuned on tabular data are vulnerable to membership inference attacks, with AUROC up to 97.7% after three epochs and encoding format strongly affecting leakage.
-
LAKEGEN: A LLM-based Tabular Corpus Generator for Evaluating Dataset Discovery in Data Lakes
LAKEGEN builds synthetic, domain-specific tabular benchmarks using ontologies and an LLM, and shows current dataset discovery methods struggle on the resulting semantic joinability tasks.
-
LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Models
LLMSynthor iteratively prompts an LLM to propose corrective batches of micro-records, aligning synthetic data with target macro-statistics while preserving realistic joint dependencies.
-
A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data
A metric-oriented survey that classifies intrinsic quality and trustworthiness metrics for LLM-generated data across six modalities and documents systematic evaluation gaps in the current literature.
-
Automatic Demonstration Selection for LLM-based Tabular Data Classification
A spectral-gap heuristic on a token-ID similarity graph automatically chooses the number of in-context demonstrations for LLM-based tabular classification, with mixed empirical results against random selection.
-
The Prompt is Mightier than the Example
Injecting domain knowledge into prompts can substitute for many in-context examples in LLM-based synthetic tabular data generation, cutting required example counts by 40-90%.
-
FASTGEN: Fast and Cost-Effective Synthetic Tabular Data Generation with LLMs
FASTGEN uses an LLM to infer per-field distributions and generate reusable Python sampling scripts, cutting token cost by 60x at 10,000 records while approximately matching direct-generation quality on several metrics.
-
Does Prompt Design Impact Quality of Data Imputation by LLMs?
Group-wise CSV prompts with correlation-based column pruning reduce LLM imputation prompt size while roughly maintaining or slightly improving classifier-based imputation quality on two imbalanced datasets.
-
Synthetic Tabular Data Generation: A Comparative Survey for Modern Techniques
A survey that categorizes tabular data synthesis by generation objectives and adds a benchmark comparison of six models on Adult and CreditRisk.
-
Synthetic Tabular Data: Methods, Attacks and Defenses
A review of tabular synthetic data generation, privacy attacks, and defenses, whose central message is that synthetic data alone does not guarantee privacy.
Discussion (0). Continue with ORCID to comment.