Pith. sign in

REVIEW 13 cited by

The Stack: 3 TB of permissively licensed source code

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2211.15533 v1 pith:WCJXKTDV submitted 2022-11-20 cs.CL cs.AI

classification cs.CLcs.AI
keywords codedatasetlicensedpermissivelystackdatahttpsbigcode
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large Language Models (LLMs) play an ever-increasing role in the field of Artificial Intelligence (AI)--not only for natural language processing but also for code understanding and generation. To stimulate open and responsible research on LLMs for code, we introduce The Stack, a 3.1 TB dataset consisting of permissively licensed source code in 30 programming languages. We describe how we collect the full dataset, construct a permissively licensed subset, present a data governance plan, discuss limitations, and show promising results on text2code benchmarks by training 350M-parameter decoders on different Python subsets. We find that (1) near-deduplicating the data significantly boosts performance across all experiments, and (2) it is possible to match previously reported HumanEval and MBPP performance using only permissively licensed data. We make the dataset available at https://hf.co/BigCode, provide a tool called "Am I in The Stack" (https://hf.co/spaces/bigcode/in-the-stack) for developers to search The Stack for copies of their code, and provide a process for code to be removed from the dataset by following the instructions at https://www.bigcode-project.org/docs/about/the-stack/.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 13 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 38 citations worldwide. Full citation record

  1. Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

    cs.LG 2026-07 conditional novelty 7.0 of 10

    In a small MLA language model, the compressed KV cache carries content/entity information but little positional information, and all five induction heads appear in one layer.

  2. Basis Transformers for Multi-Task Tabular Regression

    cs.LG 2025-06 conditional novelty 7.0 of 10

    Basis transformers beat fine-tuned LLMs on 34 multi-task tabular regression datasets while using five times fewer parameters and no data preprocessing.

  3. RTLCurator: Label-Efficient Data Curation for RTL Generation

    cs.AR 2026-07 conditional novelty 6.0 of 10

    Keeping 80% of a synthetic RTL corpus selected by a behavior-aware alignment score plus coverage and structural balancing outperforms training on the full corpus, with only 10% of pairs validated.

  4. GVR-Coder: A Visual-Feedback Framework for Structured SVG Generation in Complex Document and Meeting Scenarios

    cs.LG 2026-07 conditional novelty 6.0 of 10

    A curriculum-plus-RL-plus-repair SVG agent, trained on a new 100K office-diagram dataset, beats strong LLM baselines on layout-correct logical diagrams from long professional text.

  5. SimulS2ST-Omni: Data-Efficient Streaming Speech-to-Speech Translation via Explicit Trajectory Supervision

    cs.SD 2026-07 conditional novelty 6.0 of 10

    A joint text-code trajectory supervision recipe lets a two-stream speech LM achieve competitive long-form streaming S2ST with ~2k hours of paired speech.

  6. EmbeddedKittens: An Evaluation of Code Embeddings for Scratch

    cs.SE 2026-07 conditional novelty 6.0 of 10

    Structure-aware embeddings such as GGNN transfer to Scratch and can support sprite naming and, with weaker evidence, correctness and progress prediction.

  7. Targeted Recovery of Weight-Space Mechanisms From Neural Networks

    cs.LG 2026-06 conditional novelty 6.0 of 10

    A targeted decomposition method recovers the weight-space mechanisms behind specific inputs at low FLOPs, enabling focused ablation and rewiring of a 12-block transformer.

  8. Investigating Training Data Detection in AI Coders

    cs.SE 2025-07 conditional novelty 6.0 of 10

    Most existing training-data detection methods perform poorly on code, while prefix-relative method ReCaLL consistently scores highest, though all degrade under code mutations.

  9. SCGAgent: Recreating the Benefits of Reasoning Models for Secure Code Generation with Agentic Workflows

    cs.CR 2025-06 conditional novelty 6.0 of 10

    An agentic workflow with security guidelines and LLM-generated unit tests improves secure code generation on CWEval C tasks from 61% to 76% Func-Sec@1 with Sonnet-3.7, at roughly 98% of its original functionality.

  10. Chameleon: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning

    cs.LG 2025-05 conditional novelty 6.0 of 10

    Chameleon uses kernel ridge leverage scores on domain embeddings to set LLM training-mixture weights, matching DoGE-level pretraining quality at roughly one fifth the compute and improving finetuning perplexity.

  11. Eradicating the Unseen: Detecting, Exploiting, and Remediating a Path Traversal Vulnerability across GitHub

    cs.CR 2025-05 conditional novelty 6.0 of 10

    A single vulnerable Node.js path traversal pattern was found in 1,756 GitHub projects, most rated critical, and the authors' automated pipeline produced patches, disclosures, and evidence that LLMs have learned the pattern.

  12. CIDRe: A Reference-Free Multi-Aspect Criterion for Code Comment Quality Measurement

    cs.SE 2025-05 reject novelty 5.0 of 10

    CIDRe is a reference-free, four-part quality score for structured code comments, validated on 840 manually labeled Russian comments and reported to improve comment generation after dataset filtering.

  13. Applying the Chinese Wall Reverse Engineering Technique to Large Language Model Code Editing

    cs.SE 2025-07 conditional novelty 3.0 of 10

    Using Gemini 2.5 Pro to annotate code with edit instructions improved Comma v0.1 1T's CanItEdit pass@20 from 20.00 to 33.33 and Starcoder2 Instruct's pass@1 from 35.10 to 42.05.

Pith tools