Pith. sign in

REVIEW 16 cited by

Language Models are Realistic Tabular Data Generators

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2210.06280 v2 pith:DN4PKUTH submitted 2022-10-12 cs.LG

classification cs.LG
keywords datatabulargenerativegenerationgreatmodelsrealisticsynthetic
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Tabular data is among the oldest and most ubiquitous forms of data. However, the generation of synthetic samples with the original data's characteristics remains a significant challenge for tabular data. While many generative models from the computer vision domain, such as variational autoencoders or generative adversarial networks, have been adapted for tabular data generation, less research has been directed towards recent transformer-based large language models (LLMs), which are also generative in nature. To this end, we propose GReaT (Generation of Realistic Tabular data), which exploits an auto-regressive generative LLM to sample synthetic and yet highly realistic tabular data. Furthermore, GReaT can model tabular data distributions by conditioning on any subset of features; the remaining features are sampled without additional overhead. We demonstrate the effectiveness of the proposed approach in a series of experiments that quantify the validity and quality of the produced data samples from multiple angles. We find that GReaT maintains state-of-the-art performance across numerous real-world and synthetic data sets with heterogeneous feature types coming in various sizes.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 16 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FairDiffuseVQVAE: Sampling-Time Fairness in Tabular Diffusion via Conditional Refinement of Vector-Quantized Latents

    cs.LG 2026-07 conditional novelty 6.0 of 10

    FairDiffuseVQVAE reaches state-of-the-art fairness on the standard tabular benchmark (DPR 0.702, EOR 0.686) by uniform protected-attribute sampling at inference, paying ~15 AUC points of utility.

  2. From Noise to Order: Learning to Rank via Denoising Diffusion

    cs.IR 2026-02 conditional novelty 6.0 of 10

    DiffusionRank, a diffusion-based generative model over feature-label tuples, improves learning-to-rank over discriminative baselines on MQ2007 and MSLR-WEB10K, but not consistently on MQ2008.

  3. TAGAL: Tabular Data Generation using Agentic LLM Methods

    cs.LG 2025-09 conditional novelty 6.0 of 10

    TAGAL uses an agentic LLM loop, generation plus feedback, to produce synthetic tabular data without LLM training, matching trained models on some datasets and beating the training-free EPIC baseline.

  4. Ensembling Membership Inference Attacks Against Tabular Generative Models

    cs.CR 2025-09 conditional novelty 6.0 of 10

    No single membership inference attack dominates across tabular generative models, and unsupervised ensembles of attacks achieve better average rankings.

  5. Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches

    cs.LG 2025-08 conditional novelty 6.0 of 10

    Serialization format and in-context examples change both accuracy and gender fairness of LLM loan approvals, with finance-tuned models often showing larger disparities.

  6. Meta-learning ecological priors from large language models explains human learning and decision making

    q-bio.NC 2025-08 conditional novelty 6.0 of 10

    A meta-learned transformer trained on LLM-generated tasks (ERMI) outperforms classical cognitive models in predicting human choices across function learning, category learning, and decision making.

  7. Tab-MIA: A Benchmark Dataset for Membership Inference Attacks on Tabular Data in LLMs

    cs.CR 2025-07 conditional novelty 6.0 of 10

    Tab-MIA shows LLMs fine-tuned on tabular data are vulnerable to membership inference attacks, with AUROC up to 97.7% after three epochs and encoding format strongly affecting leakage.

  8. LAKEGEN: A LLM-based Tabular Corpus Generator for Evaluating Dataset Discovery in Data Lakes

    cs.DB 2025-07 conditional novelty 6.0 of 10

    LAKEGEN builds synthetic, domain-specific tabular benchmarks using ontologies and an LLM, and shows current dataset discovery methods struggle on the resulting semantic joinability tasks.

  9. LLMSynthor: Macro-Aligned Micro-Records Synthesis with Large Language Models

    cs.LG 2025-05 conditional novelty 6.0 of 10

    LLMSynthor iteratively prompts an LLM to propose corrective batches of micro-records, aligning synthetic data with target macro-statistics while preserving realistic joint dependencies.

  10. A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data

    cs.AI 2026-01 conditional novelty 5.0 of 10

    A metric-oriented survey that classifies intrinsic quality and trustworthiness metrics for LLM-generated data across six modalities and documents systematic evaluation gaps in the current literature.

  11. Automatic Demonstration Selection for LLM-based Tabular Data Classification

    cs.LG 2025-06 reject novelty 5.0 of 10

    A spectral-gap heuristic on a token-ID similarity graph automatically chooses the number of in-context demonstrations for LLM-based tabular classification, with mixed empirical results against random selection.

  12. The Prompt is Mightier than the Example

    cs.LG 2025-05 conditional novelty 5.0 of 10

    Injecting domain knowledge into prompts can substitute for many in-context examples in LLM-based synthetic tabular data generation, cutting required example counts by 40-90%.

  13. FASTGEN: Fast and Cost-Effective Synthetic Tabular Data Generation with LLMs

    cs.LG 2025-07 conditional novelty 4.0 of 10

    FASTGEN uses an LLM to infer per-field distributions and generate reusable Python sampling scripts, cutting token cost by 60x at 10,000 records while approximately matching direct-generation quality on several metrics.

  14. Does Prompt Design Impact Quality of Data Imputation by LLMs?

    cs.LG 2025-06 conditional novelty 4.0 of 10

    Group-wise CSV prompts with correlation-based column pruning reduce LLM imputation prompt size while roughly maintaining or slightly improving classifier-based imputation quality on two imbalanced datasets.

  15. Synthetic Tabular Data Generation: A Comparative Survey for Modern Techniques

    cs.LG 2025-07 conditional novelty 3.0 of 10

    A survey that categorizes tabular data synthesis by generation objectives and adds a benchmark comparison of six models on Adult and CreditRisk.

  16. Synthetic Tabular Data: Methods, Attacks and Defenses

    cs.LG 2025-06 conditional novelty 1.0 of 10

    A review of tabular synthetic data generation, privacy attacks, and defenses, whose central message is that synthetic data alone does not guarantee privacy.

Pith tools