Pith. sign in

REVIEW 2 cited by

PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.09477 v2 pith:HVOKA4M3 submitted 2024-02-12 cs.CR cs.LG

classification cs.CRcs.LG
keywords datapanoramiamodelsprivacytraininggeneratedlearningmachine
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We present PANORAMIA, a privacy leakage measurement framework for machine learning models that relies on membership inference attacks using generated data as non-members. By relying on generated non-member data, PANORAMIA eliminates the common dependency of privacy measurement tools on in-distribution non-member data. As a result, PANORAMIA does not modify the model, training data, or training process, and only requires access to a subset of the training data. We evaluate PANORAMIA on ML models for image and tabular data classification, as well as on large-scale language models.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. In-Context Probing for Membership Inference in Fine-Tuned Language Models

    cs.CR 2025-12 conditional novelty 6.0 of 10

    ICP-MIA infers membership in fine-tuned LLMs by measuring confidence improvement under in-context probes, beating prior black-box attacks at low false-positive rates.

  2. Ensembling Membership Inference Attacks Against Tabular Generative Models

    cs.CR 2025-09 conditional novelty 6.0 of 10

    No single membership inference attack dominates across tabular generative models, and unsupervised ensembles of attacks achieve better average rankings.

Pith tools