Pith. sign in

REVIEW 3 major objections 3 minor 125 references

Probabilistic "Copies" in Generative AI Models

T0 review · 3 major / 3 minor · reviewed 2026-08-02 · deepseek-v4-flash

Pith's one-line read A language model contains a copyrighted copy only when the work can be pulled out of it with little effort.

desk verdict A thoughtful, novel legal argument that AI model weights are copies only when extraction is easy, but the load-bearing ease-of-extraction threshold is not in the statute and depends on decoding choices. read the letter →

arxiv 2607.14532 v1 pith:3IRB7PF7 submitted 2026-07-16 cs.CY

classification cs.CY
keywords copyrightfixationLLMmemorizationextractionprobabilisticcopygenerativeAIfairusemodelweightstransitoryduration
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper faces a question copyright law has not answered: when a generative model stores a copyrighted work only as probabilistic relationships in its weights, is the model itself a "copy" of that work? The paper argues that the most likely legal answer is functional, not metaphysical: the model contains a copy if, and only if, the work can be extracted from it with relatively little effort. Deterministic or near-deterministic extraction makes the weights a fixed copy; extraction that needs hundreds or thousands of probabilistic attempts does not, even though the occasional output may still infringe. The answer matters because it decides whether the model itself, and every redistributed copy of the model, is an infringing article before any infringing output occurs. The paper is candid that it finds this result unsatisfying as policy and suggests statutory change.

What carries the argument

The load-bearing distinction is between the fixed probability distribution a model's weights define and the decoding procedure that selects outputs from that distribution. The paper's legal test is "ease of extraction": a work is fixed in the model when a deterministic (or near-deterministic, high-probability) decoding path returns it with minimal prompting; a work that appears only after many stochastic attempts is not fixed, because it arises at the moment of generation rather than persisting in the weights. The analogies to compiled code, video games, and lossy compression carry this distinction into copyright doctrine.

What would settle it

A court decision holding that a model contains a "copy" whenever a copyrighted work is demonstrably encoded in its weights, without regard to extraction probability or effort, would falsify the paper's central prediction; likewise, a ruling that generation-on-the-fly from probabilistic weights satisfies the fixation requirement would do so.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that copyright's fixation requirement, applied to LLMs, splits along an ease-of-extraction line. A model is a copy of a work when the work is retrievable directly and repeatably through a simple prompt, because the weights then act like stored instructions for reproducing the work. When the work surfaces only probabilistically, with many non-infringing outputs for every successful reproduction, what is stored is a set of ingredients, not the end product; the output may be an infringing copy at the moment it is generated, but the latent potential for it is not. Consequently, whether a particular model contains a copy of a particular work is a

Load-bearing premise

The argument assumes that a work appearing in output only once in thousands of tries is not "fixed" in the model for a period of more than transitory duration, so the latent encoding in the weights does not by itself make a copy.

Editorial extensions

If this is right

  • Models that reproducibly generate a whole work from a short prompt are themselves prima facie infringing copies, even if no one ever requests the output.
  • Every person who downloads and redistributes such an open-weight model makes a new infringing copy of the works encoded in it, expanding exposure for open distribution relative to closed APIs.
  • Works extractable only probabilistically (say, one success in a thousand tries) do not make the model a copy, even though a lucky output can still be infringing.
  • If a model is a copy, withdrawal remedies like injunction and destruction become available; and since removing memorized content from trained weights is unreliable, fair use and output-focused rules take on greater weight.
  • Because extraction methods improve over time, a given model can cross the copy line without its weights changing.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: the ease-of-extraction threshold is a moving target, so legal exposure would become partly a function of forensic technique; a model could be declared a copy after a new extraction paper, not after any change in the model.
  • Editorial inference: a strict reading of the functional test would treat copyright status as a design variable, because developers could keep outputs below the ease threshold by adding stochastic decoding or filters, shifting infringement risk from the model to the output.
  • Editorial inference: a quantitative operationalization of "relatively little effort" (for example, a threshold on expected number of attempts or on extraction probability) would make the test administrable, but no such number is derivable from the statute.
  • Editorial inference: if courts instead held that anything fixed in the weights is a copy regardless of extractability, the paper's functional line would be bypassed and nearly every large model would contain copies of some works; that outcome is the contingency the paper treats as the main doctrinal risk.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 3 minor

Summary. This law review article asks whether an LLM's weights contain a 'copy' of a copyrighted work when the model can reproduce the work only probabilistically. The authors distinguish deterministic or near-deterministic extraction (e.g., Llama 3.1 70B reproducing Harry Potter from a short prompt), which they argue makes the weights a fixed copy, from cases requiring many stochastic attempts (e.g., 1 in 1000), which they argue leaves only 'ingredients' and not a copy. They ground the distinction in 17 U.S.C. § 101's fixation requirement, analogize to compiled code, video games, and lossy compression, and conclude that the most likely judicial answer is functional: a model contains a copy of a work if and only if the work can be extracted with relatively little effort. The paper is explicitly tentative and proposes policy alternatives.

Significance. The paper is the first sustained attempt to connect the ML literature on probabilistic memorization and extraction to the statutory definition of 'copy.' If its functional test were accepted, it would create a work-by-work, model-by-model evidentiary inquiry and would expose open-weight models to greater direct-infringement risk than closed models. The paper's honest hedging and careful technical explanation of decoding procedures are strengths. However, the central legal premise — that 'relatively little effort' is the correct reading of § 101's 'can be perceived, reproduced, or otherwise communicated' — is asserted rather than demonstrated, and the proposed test is not a stable property of the model.

major comments (3)
  1. [Part II.A and Conclusion] The central test — a model contains a copy 'if, but only if, the work can be extracted with relatively little effort' — reads an ease-of-extraction threshold into § 101 that the statute does not contain. The definition of 'copies' speaks of material objects 'from which the work can be perceived, reproduced, or otherwise communicated,' with no qualifier about probability, persistence of effort, or determinism. The paper itself concedes in Part I.B that memorized training data are encoded in the weights 'regardless of whether they can be extracted' and that extraction is 'a symptom of memorization, not its cause.' If the work is encoded in a permanent material object, repeated stochastic sampling can reproduce it, so 'can be reproduced' is literally satisfied. The buffer-copy cases (Cartoon Network, CoStar) concern transitory duration, not low-probability persistence. No case is cited for
  2. [Part II.C (0.1% extraction and beam search)] The proposed ease-of-extraction test is not a stable property of the model; it varies with the user-chosen decoding procedure. The paper acknowledges (footnote 126 and surrounding text) that a sequence with extraction probability 1/1000 may nonetheless be returned deterministically by beam search if it is the highest-probability continuation. Thus the same weights would be a 'copy' for a weakly memorized passage when decoded with beam search, but 'ingredients' when decoded by stochastic sampling. The legal status of a fixed material object would flip based on which algorithm a litigant runs. Fixation doctrine asks whether the embodiment is sufficiently permanent, not whether a particular machine or device retrieves it conveniently. This instability undermines the functional test as a matter of statutory interpretation.
  3. [Part II.B] The analogies to compiled code, lossy compression, and video games do not support the conclusion that probabilistic extraction is not fixation. All of the analogies involve deterministic or effectively deterministic systems, and the paper itself distinguishes video games on precisely that ground. But the paper's own technical account in Part I.A shows that an LLM is a fixed set of weights defining a fixed probability distribution; output variability arises from the decoding procedure, not from the model. A memorized sequence is encoded with high fidelity in those fixed weights. The 'on the fly' framing thus conflates the act of generating a particular output with the persistence of encoded information in the model. The internal tension between the technical premise (encoded regardless of extractability) and the legal conclusion (no copy unless easily extracted) is not resolved.
minor comments (3)
  1. [Figure 2 caption] The caption reports a '99.2% match' but does not specify the metric or the alignment method. Clarify whether this is character-level, token-level, or something else, since the claim of 'near-exact' is central to the Harry Potter example.
  2. [Footnotes 119 and 126] The discussion of 1/1000 probability and deterministic beam search is crucial and arguably contradicts the paper's clean dichotomy. It should be moved into the main text and engaged directly, rather than appearing as a caveat in footnotes.
  3. [References] Several load-bearing empirical sources are unpublished preprints or are cited as 'Cooper Untitled,' 'Extractable Memorization From First Principles' (arXiv:2607.12649), and other 2026 manuscripts. For reproducibility, the authors should either cite peer-reviewed versions or provide a stable artifact/DOI.

Circularity Check

0 steps flagged · score 2.0 of 10

No significant circularity: the statutory analysis and functional test are independent of the empirical extraction evidence, though key empirical examples rely on the authors' own preprints.

full rationale

The paper's central claim is a legal prediction: courts will likely treat a model as containing a copy only when the work can be extracted with relatively little effort (Conclusion, II.C). That claim is constructed from statutory text (17 U.S.C. § 101), case law on fixation (Cartoon Network, CoStar, Kelley, video-game and compiled-code analogies), and policy arguments in Part II, not from the empirical extraction results in Part I. The extraction findings (e.g., Llama 3.1 70B generating Harry Potter) are used as illustrative evidence, not as the definitional ground of the legal conclusion. The paper expressly concedes that memorized data are encoded in weights even when not extractable (I.B), so the 'copy' determination does not collapse into the presence of an encoded work; it is instead a separate normative/doctrinal line-drawing exercise. The heavy reliance on the authors' own preprints (Extracting Books, Near-Verbatim, Extractable Memorization From First Principles) means the empirical illustrations are not independently verified within the paper, but those preprints are empirical, falsifiable studies of extraction probabilities and do not themselves assume the copyright conclusion. No equation or construction makes a 'prediction' equal to its input. Therefore no specific circular step is exhibited; the paper is best characterized as relying on self-cited empirical support within an otherwise independent legal derivation.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

No new physical or technical entity is postulated; 'probabilistic copy' is a legal characterization, not an entity. The two free parameters are the ease-of-extraction thresholds used to distinguish copies from non-copies. The axioms are the technical and interpretive premises needed to connect memorization science to fixation doctrine.

free parameters (2)
  • Ease-of-extraction threshold ('relatively little effort') = Not quantified; calibrated by examples: >95% extraction probability for Harry Potter, ~0.1% for the middle class, 1-in-1
    The legal conclusion turns on distinguishing straightforward from probabilistic extraction, but no statutory or case-law basis fixes this threshold; it is chosen by the authors from their own extraction results.
  • Extraction probability threshold for 'copy' = >95% for deterministic copy; ~0.1% via beam search; 1/1000 as illustrative probabilistic case
    Used to classify works as copied versus not copied in the model; these numbers come from the authors' empirical studies, not from the law.
assumptions (4)
  • domain assumption Memorized training data are encoded in model weights, and extraction is a symptom of that encoding.
    Invoked in Part I.B; central to linking empirical extraction to legal copy analysis; relies on the ML literature, including the authors' own papers.
  • domain assumption The Copyright Act's fixation requirement demands a stable embodiment from which the work can be perceived or reproduced; on-the-fly probabilistic generation does not satisfy it.
    Parts II.B-II.C; the conclusion depends on interpreting 'sufficiently permanent or stable' as excluding probabilistic outputs; case law on point is analogical, not direct.
  • domain assumption A compressed or encoded representation counts as a copy if it is deterministic and reliably reproducible.
    Part II.B; used to analogize model weights to compiled code and video game content, and to distinguish Microsoft Word as a non-copy.
  • domain assumption Failure to extract a work does not prove it is absent from the model.
    Part I.B; the paper uses this to hedge its negative examples like Sandman Slim, but the premise also makes the proposed legal test inherently provisional.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Probabilistic "Copies" in Generative AI Models." pith.science (2026). https://pith.science/paper/3IRB7PF7

@misc{pith2026260714532,
  author       = {Pith},
  title        = {Pith review of: Probabilistic "Copies" in Generative AI Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/3IRB7PF7}},
  note         = {Machine review of arXiv:2607.14532}
}
read the original abstract

Recent work shows that it is possible to extract verbatim or near-verbatim text of some copyrighted works from some large language models (LLMs or models). That is evidence that the model weights encode the works in some form - that the model has "memorized" those works from its training data. But LLMs don't store information in the same format as familiar databases. Rather, their weights store statistical relationships between tokens that have been learned from the training data, and those relationships inform a generation process that is often probabilistic rather than deterministic. In the case of memorization, those relationships are strong enough that, in many circumstances, the model might generate a copyrighted work from its training data with some probability. Copyright law has not previously had to decide whether storing information that might or might not produce output similar to a copyrighted work is itself a copy of the work. The answer to the question is important, because it may determine the legality of many LLMs. The statute and case law are largely unhelpful. We argue that copyright law will likely take a functional approach to the question, finding that LLMs contain a copy of a particular work only if it is straightforward to extract that work in outputs. That result is unsatisfying as a policy matter, and we suggest potential changes to the law, but it is the most likely outcome under current law.

Figures

Figures reproduced from arXiv: 2607.14532 by the authors.

Figure 1
Figure 1. Illustrating autoregressive generation. The input prompt is “Mr. and Mrs. Durs,” for which the (autoregressive) LLM produces a distribution over the next tokens in its vocabulary (all possible tokens it can generate). At each generation step, the decoding procedure illustrated here selects the highest-probability token as the one to generate. In this example, the top-ranked token has enormous probability at each ste… view at source ↗
Figure 3
Figure 3. We know that this book was in Llama’s training data, [PITH_FULL_IMAGE:figures/full_fig_p018_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

125 extracted references · 1 canonical work pages

  1. [1]

    URL https://www.atkins onailaw.com/intersecting- ai/litigation-tracker

    AtkinsonAILaw AI Litigation Tracker, 2026. URL https://www.atkins onailaw.com/intersecting- ai/litigation-tracker

  2. [2]

    URL https://chatgptiseatingt heworld.com

    ChatGPT Is Eating the World, 2026. URL https://chatgptiseatingt heworld.com

  3. [3]

    Anthropic PBC

    Bartz v. Anthropic PBC. 787 F. Supp. 3d 1007 (N.D. Cal. 2025)

  4. [4]

    Meta Platforms, Inc

    Kadrey v. Meta Platforms, Inc. 788 F. Supp. 3d 1026 (N.D. Cal. 2025)

  5. [5]

    Thomson Reuters Enter. Ctr. GMBH v. Ross Intel. Inc. 765 F. Supp. 3d 382, 401 (D. Del. Feb. 11, 2025)

  6. [6]

    New York Times Co. v. Microsoft Co. 777 F. Supp. 3d 283, 307 (S.D.N.Y. 2025)

  7. [7]

    Copyright Infringement Litigation

    In re OpenAI, Inc. Copyright Infringement Litigation. No. 25-md-3143, 2025 U.S. Dist. LEXIS 211544, at *108 (S.D.N.Y 2025)

  8. [8]

    OpenAI, Inc

    Tremblay v. OpenAI, Inc. 716 F. Supp. 3d 772, 778 (N.D. Cal. 2024)

Show all 125 references
  1. [9]

    GEMA v. OpenAI. 42 O 14139/24 (LG Munchen 11 Nov. 2025)

  2. [10]

    Stability AI Ltd

    Andersen v. Stability AI Ltd. 700 F. Supp. 3d 853, 865 (N.D. Cal. 2023)

  3. [11]

    OpenAI Used Song Lyrics in Violation of Copyright Laws, German Court Says

    Jorn Poltz and Friederike Heine. OpenAI Used Song Lyrics in Violation of Copyright Laws, German Court Says. Reuters, November 2025. URL https://www.reuters.com/world/german-court- sides-with-plaintiff-copyright-case-against- openai-2025-11-11/

  4. [12]

    Stability AI Limited

    Getty Images (US) Inc & Ors v. Stability AI Limited. [2025] EWHC 2863 (Ch). 44 Berkeley Technology Law Journal [Vol. 41:1

  5. [13]

    Feder Cooper and James Grimmelmann

    A. Feder Cooper and James Grimmelmann. The Files are in the Computer: Copyright, Memorization, and Generative AI. arXiv preprint arXiv:2404.12590, 2024

  6. [14]

    Feder Cooper, Katherine Lee, James Grimmelmann, Daphne Ippolito, Christopher Callison-Burch, Christopher A

    A. Feder Cooper, Katherine Lee, James Grimmelmann, Daphne Ippolito, Christopher Callison-Burch, Christopher A. Choquette-Choo, Niloofar Mireshghallah, Miles Brundage, David Mimno, Madiha Zahrah Choksi, Jack M. Balkin, Nicholas Carlini, Christopher De Sa, Jonathan Frankle, Deep...

  7. [15]

    Does learning require memorization? A short tale about a long tail

    Vitaly Feldman. Does learning require memorization? A short tale about a long tail. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing, STOC 2020, page 954–959, New York, NY, USA, 2020. Association for Computing Machinery

  8. [16]

    Membership inference attacks against machine learning models

    Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov . Membership inference attacks against machine learning models. In 2017 IEEE symposium on security and privacy (SP), pages 3–18. IEEE, 2017

  9. [17]

    Extracting training data from large language models

    Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, U lfar Erlingsson, et al. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21), page...

  10. [18]

    Deduplicating Training Data Makes Language Models Better

    Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison -Burch, and Nicholas Carlini. Deduplicating Training Data Makes Language Models Better. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, volume...

  11. [19]

    Feder Cooper, Daphne Ippolito, Christopher A

    Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski , A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette -Choo, Eric Wallace, Florian Tram er, and Katherine Lee. Scalable Extraction of Training Data from (Production) Language Models. arXiv prepri nt arXiv:...

  12. [20]

    Feder Cooper, Aaron Gokaslan, Amy B

    A. Feder Cooper, Aaron Gokaslan, Amy B. Cyphert, Christopher De Sa, Mark A. Lemley, Daniel E. Ho, and Percy Liang. Extracting memorized pieces of (copyrighted) books from open -weight language models. ArXiv preprint arXiv:2505.12546, 2025

  13. [21]

    Copyright Violations and Large Language Models, 2023

    Antonia Karamolegkou, Jiaang Li, Li Zhou, and Anders Søgaard. Copyright Violations and Large Language Models, 2023. URL https://arxi v.org/abs/2310.13771

  14. [22]

    Feder Cooper, Sanmi Koyejo, and Percy Lia ng

    Ahmed Ahmed, A. Feder Cooper, Sanmi Koyejo, and Percy Lia ng. Extracting books from production language models. arXiv preprin t arXiv:2601.02671, 2026

  15. [23]

    Copyright detective: A forensic system to evidence LLMs flickering copyright leakage r isks, 2026

    Guangwei Zhang, Jianing Zhu, Cheng Qian, Neil Gong, Rada Mihalcea, Zhaozhuo Xu, Jingrui He, Jiaqi Ma, Yun Huang, Chaowei Xiao, Bo Li, Ahmed Abbasi, Dongwon Lee, Heng Ji, and Denghui Zhang. Copyright detective: A forensic system to evidence LLMs flickering copyright leakage r i...

  16. [24]

    Feder Cooper, Mark A

    A. Feder Cooper, Mark A. Lemley, Christopher De Sa, Lea Duesterwald, Allison Casasola, Jamie Hayes, Katherine Lee, Daniel E. Ho, an d Percy Liang. Estimating near -verbatim extraction risk in language model s with decoding -constrained beam search. arXiv preprint arXiv:2603.24...

  17. [25]

    Universal Pictures Co. v. Harold Lloyd Corp. 162 F.2d 354, 361 (9th Cir. 1947)

  18. [26]

    Sid & Marty Krofft Television Prods., Inc. v. McDonald’s Corp. 562 F.2d 1157, 1164 (9th Cir. 1977)

  19. [27]

    Arnstein v. Porter. 154 F.2d 464, 473 (2d Cir. 1946)

  20. [28]

    Mark A. Lemley. Our Bizarre System for Proving Copyright Infringement. Journal of the Copyright Society, 57, 2010

  21. [29]

    Extracting Training Data from Diffusion Models, 2023

    Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikas h Sehwag, Florian Tramer, Borja Balle, Daphne Ippolito, and Eric Wallace. Extracting Training Data from Diffusion Models, 2023. 46 Berkeley Technology Law Journal [Vol. 41:1

  22. [30]

    What my privacy papers (don’t) have to say abo ut copyright and generative AI, 2025

    Nicholas Carlini. What my privacy papers (don’t) have to say abo ut copyright and generative AI, 2025. URL https://nicholas.carlini.c om/writing/2025/privacy-copyright-and- generative-models.ht ml

  23. [31]

    Rethinking llm memorization through the lens of adversarial compression

    Avi Schwarzschild, Zhili Feng, Pratyush Maini, Zachary C Lipton, and J Zico Kolter. Rethinking llm memorization through the lens of adversarial compression. arXiv preprint arXiv:2404.15146, 2024

  24. [32]

    Training foundation models as data compression: On information, model weights and c opyright law, 2025

    Giorgio Franceschelli, Claudia Cevenini, and Mirco Musolesi. Training foundation models as data compression: On information, model weights and c opyright law, 2025. URL https://arxiv.org/abs/2407.13493

  25. [33]

    Copyright and Artificial Intelligence Part 3: Generative AI Training

    United States Copyright Office. Copyright and Artificial Intelligence Part 3: Generative AI Training. 2025

  26. [34]

    The Heart of the Matter: Copyright, AI Trainin g, and LLMs

    Daniel Gervais et al. The Heart of the Matter: Copyright, AI Trainin g, and LLMs. Journal of the Copyright Society, 2025

  27. [35]

    Pseudo -Expressions: An Expanded conception of th e Work in Copyright Law, 2025

    Joshua Yuvaraj. Pseudo -Expressions: An Expanded conception of th e Work in Copyright Law, 2025

  28. [36]

    Privacy and Power: Computer Databases and Metaphors for I nformation Privacy

    Daniel Solove. Privacy and Power: Computer Databases and Metaphors for I nformation Privacy. Stanford Law Review, 53, 2001

  29. [37]

    Feder Cooper, and James Grimmelmann

    Katherine Lee, A. Feder Cooper, and James Grimmelmann. Talki n’ ’Bout AI Generation: Copyright and the Generative -AI Supply Chain. arXiv preprint arXiv:2309.08133, 2023

  30. [38]

    Michael A. Smit. Metaphors we judge (AI) by: a rhetorica l analysis of artificial copyright disputes. Journal of Intellectual Property Law & Practice, 21, 2026

  31. [39]

    Porter, and Aneesh Papp u

    Jamie Hayes, Ilia Shumailov, William P. Porter, and Aneesh Papp u. Measuring memorization in RLHF for code completion. In The Thirteenth International Conference on Learning Representations ,

  32. [40]

    Language Modeling Is Compression

    Gregoire Deletang, Anian Ruoss, Paul-Ambroise Duquenne, Elliot Catt, Tim Genewein, Christopher Mattern, Jordi Grau -Moya, Li Kevin 2026] PROBABILISTIC COPIES IN GENERATIVE AI MODELS 47 Wenliang, Matthew Aitchison, Laurent Orseau, Marcus Hutter, and Joel Veness. Language Modeli...

  33. [41]

    Feder Cooper, Christopher A

    A. Feder Cooper, Christopher A. Choquette -Choo, Miranda Bogen, Kevin Klyman, Matthew Jagielski, Katja Filippova, Ken Liu, Alexandra Chouldechova, et al. Machine Unlearning Doesn’t Do What You Think: Lessons for Generative AI Policy and Research. In T he Thirty-Ninth Annual Co...

  34. [42]

    Anthropic PBC’s Opposition to Plaintiffs’ Motion for Preliminary Injunction at 4, Concord Music Grp., Inc

    Def. Anthropic PBC’s Opposition to Plaintiffs’ Motion for Preliminary Injunction at 4, Concord Music Grp., Inc. v. Anthropic PBC. No. 3:23- cv-01092 (M.D. Tenn. Jan. 16, 2024)

  35. [43]

    Concord Music Grp. v. Anthropic PBC. 772 F. Supp. 3d 1131, 1134 (N.D. Cal. 2025)

  36. [44]

    Stability AI, Ltd

    First Amended Complaint at 27, Andersen v. Stability AI, Ltd. No. 3:23- cv-00201 (N.D.Cal. Nov. 29, 2023)

  37. [45]

    Copyright’s Jagged Frontier

    Matthew Sag. Copyright’s Jagged Frontier. Duke Law Journal, 2026

  38. [46]

    The Universal Lexicon: Generative AI Chatbots and Fair Use of Works in a Training Corpus

    Hannibal Travis. The Universal Lexicon: Generative AI Chatbots and Fair Use of Works in a Training Corpus. Rev. Litig., 60, 2026

  39. [47]

    Feder Cooper, Jonathan Frankle, and Christopher De Sa

    A. Feder Cooper, Jonathan Frankle, and Christopher De Sa. Non - Determinism and the Lawlessness of Machine Learning Code. In Proceedings of the 2022 Symposium on Computer Science and Law , CSLAW ’22, page 1 –8, New York, NY, USA, 2022. Association for Com-puting Machinery. ISB...

  40. [48]

    The Llama 3 Herd of Models, 2024

    Aaron Grattafiori et al. The Llama 3 Herd of Models, 2024. URL https://arxiv.org/abs/2407.21783

  41. [49]

    Qwen2.5 Technical Report, 2025

    Qwen et al. Qwen2.5 Technical Report, 2025. URL https: //arxiv.org/abs/2412.15115. 48 Berkeley Technology Law Journal [Vol. 41:1

  42. [50]

    Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy

    Daphne Ippolito, Florian Tramer, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher Choquette -Choo, and Nicholas Carlini. Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy. In C. Maria Keet, Hung-Yi Lee, and...

  43. [51]

    ChatGPT is a Blurry JPEG of the Web

    Ted Chiang. ChatGPT is a Blurry JPEG of the Web. The New Yorker, February 2023. URL https://www.newyorker.com/tech/annals-of-t echnology/chatgpt-is-a-blurry-jpeg-of-the-web

  44. [52]

    These 183,000 Books Are Fueling the Biggest Fight in Publishing and Tech

    Alex Reisner. These 183,000 Books Are Fueling the Biggest Fight in Publishing and Tech. The Atlantic , September 2023. URL https: //www.theatlantic.com/technology/archive/2023/0 9/books3-dat abase-generative-ai-training- copyright-infringement/675363/

  45. [53]

    Feder Cooper, James Grimmelmann, and Daphne Ippolito

    Katherine Lee, A. Feder Cooper, James Grimmelmann, and Daphne Ippolito. AI and Law: The Next Generation. SSRN, 2023. http://dx.doi.org/10.2139/ssrn.4580739

  46. [54]

    Measuring Non -Adversarial Reproduction of Training Data in Large Language Models

    Michael Aerni, Javier Rando, Edoardo Debenedetti, Nicholas Carlini, Daphne Ippolito, and Florian Tramer. Measuring Non -Adversarial Reproduction of Training Data in Large Language Models. In The Thirteenth International Conference on Learning Representations ,

  47. [55]

    TokenSwap: A Lightweight Method to Disrupt Memo-rized Sequences in LLMs

    Parjanya Prajakta Prashant, Kaustubh Ponkshe, and Babak Sal -imi. TokenSwap: A Lightweight Method to Disrupt Memo-rized Sequences in LLMs. In The Thirty-ninth Annual Conference on Neural Information Processing Systems , 2025. URL https://openreview.net/forum?id=gNiT81iag0

  48. [56]

    URL https://openreview.net/forum?id=590yfqz1LE

  49. [57]

    Feder Cooper, Marika Swanberg, Jamie Hayes, Lea Duesterwald, Christopher De Sa, Daniel E

    A. Feder Cooper, Marika Swanberg, Jamie Hayes, Lea Duesterwald, Christopher De Sa, Daniel E. Ho, Mark A. Lemley, and Percy Liang. Extractable Memorization From First Principles. arXiv preprint arXiv:2607.12649, 2026

  50. [58]

    Choquette -Choo, Katherine Lee, and A

    Jamie Hayes, Marika Swanberg, Harsh Chaudhari, Itay Yona, Ilia Shumailov, Milad Nasr, Christopher A. Choquette -Choo, Katherine Lee, and A. Feder Cooper. Measuring memorization in language models via probabilistic extraction. In Luis Chiruzzo, Alan Ritter, and Lu Wang, editors...

  51. [59]

    How Much Information Do LLMs Really Memorize? Now We Know, Thanks to Meta, Google, Nvidia and Cornell

    Carl Franzen. How Much Information Do LLMs Really Memorize? Now We Know, Thanks to Meta, Google, Nvidia and Cornell. VentureBeat, June 2025

  52. [60]

    Morris, Chawin Sitawarin, Chuan Guo, Narine Kokhlikyan, G

    John X. Morris, Chawin Sitawarin, Chuan Guo, Narine Kokhlikyan, G. Edward Suh, Alexander M. Rush, Kamalika Chaudhuri, and Saeed Mahloujifar. How much do language models memorize?, 2025. URL https://arxiv.org/abs/2505.24832

  53. [61]

    Gemma 2: Improving Open Language Models at a Practical Size, 2024

    Gemma Team et al. Gemma 2: Improving Open Language Models at a Practical Size, 2024. URL https://arxiv.org/abs/2408.00118

  54. [62]

    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

    Gemini Team, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy Lillicrap, Jean-baptiste Alayrac, Radu Soricut, Angeliki Lazari dou, Orhan Firat, Julian Schrittwieser, et al. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv pr...

  55. [63]

    The Fallacy of the File: How the Memorisation Metaphor Misguides Copyright Law and Stifles AI Innovation, 2025

    Aline Larroyed. The Fallacy of the File: How the Memorisation Metaphor Misguides Copyright Law and Stifles AI Innovation, 2025. URL https://ssrn.com/abstract=5782882

  56. [64]

    Quantifying Memorization Across Neural Language Models

    Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang. Quantifying Memorization Across Neural Language Models. In International Conference on Learning Representations, 2023

  57. [65]

    Cover and Joy A

    Thomas M. Cover and Joy A. Thomas. Data compression. In Elements of Information Theory, chapter 5, pages 103 –158. John Wiley & Sons, Ltd, 2005. ISBN 9780471748823. doi: https://doi.org/10.1002/047174882X.ch5. URL https: //onlinelibrary.wiley.com/doi/abs/10.1002/04717 4882X.ch5

  58. [66]

    Low-Resource

    Zhiying Jiang, Matthew Yang, Mikhail Tsirlin, Raphael Tang, Yiqin Dai, and Jimmy Lin. “Low-Resource” Text Classification: A Parameter- 50 Berkeley Technology Law Journal [Vol. 41:1 Free Classification Method with Compressors. In Anna Rogers, Jordan Boyd-Graber, and Naoaki Okaz...

  59. [67]

    Anthony Reese

    R. Anthony Reese. Public Display Right. U. Ill. L. Review, 83, 2001

  60. [68]

    We Should Separate Memorization from Copyright, 2026

    Adi Haviv, Niva Elkin -Koren, Uri Hacohen, Roi Livni, and Shay Moran. We Should Separate Memorization from Copyright, 2026. URL https://arxiv.org/abs/2602.08632

  61. [69]

    Copyright Law of the United States. U. S.C. 17, 105, November 2002. URL https://www.law.cornell.edu/uscode/text/17/106

  62. [70]

    Copyright, Derivative Works and Fixation: Is Galoob a Mirage, or Does the Form (GEN) of the Alleged Derivative Work Matter? Santa Clara Comp

    Tyler Ochoa. Copyright, Derivative Works and Fixation: Is Galoob a Mirage, or Does the Form (GEN) of the Alleged Derivative Work Matter? Santa Clara Comp. & High Tech. L.J., 20, 2004

  63. [71]

    Goldstein on Copyright

    Paul Goldstein. Goldstein on Copyright. Wolters Kluwer, 2024

  64. [72]

    Copyright Law of the United States. U. S.C. 17, 101, December 2010. URL https://www.law.cornell.edu/uscode/text/17/101

  65. [73]

    Allocating Ownership Rights in Computer - Generated Works

    Pamela Samuelson. Allocating Ownership Rights in Computer - Generated Works. U. Pitt. L. Rev., 47, 1986

  66. [74]

    National Comm’n on New Technological Uses of Copyrighted Works, Final Report, 1979

  67. [75]

    Memorization of Copyrighted Works by AI Mod els Under EU Law

    Zbigniew Okon. Memorization of Copyrighted Works by AI Mod els Under EU Law. Europejski Przeglad Sadowy , 19, 2025. URL https://download.ssrn.com/2026/1/8/6041395.pdf

  68. [76]

    Formalizing Human Ingenuity: A Quantitative Framework for Copyright Law’s Substantial 2026] PROBABILISTIC COPIES IN GENERATIVE AI MODELS 51 Similarity

    Sarah Scheffler, Eran Tromer, and Mayank Varia. Formalizing Human Ingenuity: A Quantitative Framework for Copyright Law’s Substantial 2026] PROBABILISTIC COPIES IN GENERATIVE AI MODELS 51 Similarity. In Proceedings of the Symposium on Computer Science and Law, pages 37–49, 2022

  69. [77]

    (7th Cir

    635 F.3d 290. (7th Cir. 2011)

  70. [78]

    Leistner and L

    M. Leistner and L. Antoine. TDM and AI Training in the European Union – From “LAION” to Possible Ways Ahead? GRUR Int’l , 11, 2025

  71. [79]

    Formgen Inc

    Micro Star v. Formgen Inc. 154 F.3d 1107 (9th Cir. 1998)

  72. [80]

    Williams Elecs., Inc. v. Artic Int’l, Inc. 685 F.2d 870, 874 (3d Cir. 1982)

  73. [81]

    Spielberg

    Litchfield v. Spielberg. 736 F.2d 1352, 1357 (9th Cir. 1984)

  74. [82]

    Uncharted Labs, Inc

    Justice v. Uncharted Labs, Inc. 2026 WL 1430232 (S.D.N.Y. May 21, 2026)

  75. [83]

    Mirage Editions, Inc. v. Albuquerque A.R.T. 856 F.2d 1341, 1342 –43 (9th Cir. 1988)

  76. [84]

    Nimmer on Copyright

    Melville Nimmer. Nimmer on Copyright. § 8.09[A] (1981)

  77. [85]

    H.R. Rep. No. 94–1476

  78. [86]

    Feder Cooper, Daphne Ippolito, Christopher A

    Milad Nasr, Javier Rando, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette- Choo, Florian Tramer, and Katherine Lee. Scalable Extraction of Training Data from Aligned, Production Language Models. In The Thirteenth...

  79. [87]

    URL https://openreview.net/forum?id=vjel3nWP2a

  80. [88]

    CoStar Group, Inc. v. LoopNet, Inc. 373 F.3d 544 (4th Cir. 2004)

  81. [89]

    (9th Cir

    991 F.2d 511. (9th Cir. 1993). 52 Berkeley Technology Law Journal [Vol. 41:1

  82. [90]

    CSC Holdings, Inc

    Cartoon Network LP, LLP v. CSC Holdings, Inc. 536 F.3d 121 (2d Cir. 2008)

  83. [91]

    MAI Systems Corp. v. Peak Computer. 991 F.2d 511 (9th Cir. 1993)

  84. [92]

    University Books

    Walker v. University Books. 602 F.2d 859, 864 (9th Cir. 1979)

  85. [93]

    Sega of Am. v. Accolade, Inc. 975 F.2d 1510 (9th Cir. 1992)

  86. [94]

    UMG Recordings, Inc. v. Shelter Capital Partners LLC. 718 F.3d 1006, 1019 (9th Cir. 2013)

  87. [95]

    Thoroughbred Software Intern., Inc. v. Dice Corp. 488 F.3d 352, 359 – 360 (6th Cir. 2007)

  88. [96]

    Jessica D. Litman. Fetishizing Copies. In R. Okediji, editor, Copyright in An Age of Limitations and Exceptions , pages 107 –131. Cambridge University Press, 2017

  89. [97]

    Copyright Law of the United States. U.S.C. 17, 504, October 1976. URL https://www.law.cornell.edu/uscode/text/17/504

  90. [98]

    Intellectual Property Law

    Jay Dratler. Intellectual Property Law. § 5.03[1][b], at 5–63

  91. [99]

    Luettgen

    David G. Luettgen. Functional Usefulness vs. Communicative Usefulness: Thin Copyright Protection for the Nonliteral Elements of Computer Programs. Tex. Intell. Prop. L.J., 4, 1996

  92. [100]

    Justifications for Copyright Limitations and Exceptions

    Pamela Samuelson. Justifications for Copyright Limitations and Exceptions. In R. Okediji, editor, Copyright in An Age of Limitations and Exceptions. Cambridge University Press, 2017. 2026] PROBABILISTIC COPIES IN GENERATIVE AI MODELS 53

  93. [101]

    Copyright Law of the United States. U.S.C. 17, 505, October 1976. URL https://www.law.cornell.edu/uscode/text/17/505

  94. [102]

    Legally Speaking: Does Using In-Copyright Works as Training Data Infringe?, 2026

    Pamela Samuelson. Legally Speaking: Does Using In-Copyright Works as Training Data Infringe?, 2026. URL https://ssrn.com/abstrac t=5342516

  95. [103]

    Black Entertainment Television, Inc

    Ringgold v. Black Entertainment Television, Inc. 126 F.3d 70, 75 (2d Cir. 1997)

  96. [104]

    The Class Action as Licensing and Reform Device

    Xiyin Tang. The Class Action as Licensing and Reform Device. Colum. L. Rev., 122, 2022

  97. [105]

    Castle Rock Entm’t, Inc. v. Carol Publ’g Grp., Inc. 150 F.3d 132, 138 (2d Cir. 1998)

  98. [106]

    Nextel Commc’ns & Mullen Advert., Inc

    Gordon v. Nextel Commc’ns & Mullen Advert., Inc. 345 F.3d 922, 924 (6th Cir. 2003)

  99. [107]

    Not De Minimis: Improper Appropriation in Copyright

    Oren Bracha. Not De Minimis: Improper Appropriation in Copyright. Am. U. L. Rev., 139, 2018

  100. [108]

    New Line Cinema Corp

    Sandoval v. New Line Cinema Corp. 147 F.3d 215, 217 (2d Cir. 1998)

  101. [109]

    Matthews Conveyor Co. v. Palmer -Bee Co. 135 F.2d 73, 85 (6th Cir. 1943)

  102. [110]

    Nimmer and David Nimmer

    Melville B. Nimmer and David Nimmer. Nimmer on Copyright . § 13.03[A][2] (1997)

  103. [111]

    2K Games, Inc

    Solid Oak Sketches, LLC v. 2K Games, Inc. 449 F. Supp. 3d 333, 344 (S.D.N.Y. 2020)

  104. [112]

    Fair Learning

    Mark Lemley and Bryan Casey. Fair Learning. Texas Law Review, 99: 743, 2021

  105. [113]

    Gottlieb Dev. LLC v. Paramount Pictures Corp. 590 F. Supp. 2d 625 (S.D.N.Y. 2008)

  106. [114]

    De Minimis Copying: An Empirical Study

    Jessica Silbey and Samantha Zyontz. De Minimis Copying: An Empirical Study. J. Intell. Prop. & Ent. L., 15, 2025

  107. [115]

    Language Models’ Verbatim Copying: Copyright Infringement Analysis Through the Lens of The New York Times Co

    Tian “Tony” Chen. Language Models’ Verbatim Copying: Copyright Infringement Analysis Through the Lens of The New York Times Co. V. Microsoft, OpenAI, Inc. et al. Cardozo Arts & Ent. L.J., 2025

  108. [116]

    Copyright Dilution Under Constitutional Scrutiny

    Edward Lee. Copyright Dilution Under Constitutional Scrutiny. Chi.- Kent J. Intell. Prop., 2026

  109. [117]

    Fair Use and the Origin of AI Training

    Edward Lee. Fair Use and the Origin of AI Training. Hous. L. Rev. , 2025. 54 Berkeley Technology Law Journal [Vol. 41:1

  110. [118]

    For the Visual Arts, Inc

    Andy Warhol Found. For the Visual Arts, Inc. v. Goldsmith. 598 U.S. 508, 509 (2023)

  111. [119]

    Charlesworth

    Jacqueline C. Charlesworth. Generative AI’s Illusory Case for Fair Use. Vanderbilt Journal of Entertainment and Technology Law, 2025

  112. [120]

    Sony Computer Ent., Inc. v. Connectix Corp. 203 F.3d 596, 607 (9th Cir. 2000)

  113. [121]

    Random House, Inc

    Salinger v. Random House, Inc. 811 F.2d 90, 94 (2d Cir. 1987)

  114. [122]

    Acuff-Rose Music, Inc

    Campbell v. Acuff-Rose Music, Inc. 510 U.S. 569, 570

  115. [123]

    Justifications for Fair Uses

    Pamela Samuelson. Justifications for Fair Uses. Wis. L. Rev., 2025

  116. [125]

    (CJEU 2026)

    Spotify, C-496/24. (CJEU 2026)

  117. [2025]

    https://openreview.net/forum?id=Tg8RLxpMDu

Pith tools

Reviewed August 2, 2026 · model on record in the stance chip above.