Pith. sign in

Paper Citation Record · LEDGER

Distillation Scaling Laws

As of 14 August 2026, this Paper Citation Record lists 39 of 39 outbound references and 22 inbound Pith citation observations for arXiv:2502.08606.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.08606 v2

Coverage vector

measured 39 of 39 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T04:33:08.965380Z

measured 61 of 61 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 22 of 22 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T12:32:57.249732Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-10T10:27:02.464784Z

Reference resolution

39 of 39 outbound references displayed

  • verified exact1
  • verified fuzzy14
  • unresolved20
  • parse uncertain0
  • malformed identifier4
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0cf02cdc-44dd-4812-9912-0b4874b7e6b7 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.691955Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.898143Z digest=sha256:5e2d08d2f6fad96247e6ffdf493ed563f38f653ca7e101ddf575cb1fc6ed0089

Observation ff592dfe-3e75-4c02-99ee-a51ee31e2081 · outbound

This paper cites Our setting automatically satisfies consistency as there is no augmentation policy.

Distillation Scaling Laws Our setting automatically satisfies consistency as there is no augmentation policy

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.679681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.902574Z digest=sha256:78969b8342e9d79094deb38b4d8b8cec641e18a3f25353743030490fe384e2ad

Observation bbcefb85-f25a-4720-a285-76e453384a57 · outbound

This paper cites URL https: //doi.org/10.1145/3604930.3605705.

Distillation Scaling Laws URL https: //doi.org/10.1145/3604930.3605705

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.820573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.820573Z digest=sha256:5e9a6242d127cd6bd76ab506169049f8fad5bdccedd9b981be5a817ac34a8826

Observation 0ec3c9cc-4c3c-4a7c-aa84-ae39adb9d64e · outbound

This paper cites DeepSeek-V3 Technical Report.

Distillation Scaling Laws DeepSeek-V3 Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.824784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.824784Z digest=sha256:1ce7693ae468fcc830f2b28c84d56f1003a288a95b6f1a50255987cdfcb2caba

Observation 67a722ad-a368-49fe-803c-1f6f4d4e8ccf · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.829410Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.829410Z digest=sha256:99e645847f6dd926800e0a9ebe4bc7cbe0070d82db50f6cad66f7939488e502b

Observation dbcd7b26-66fc-4ff8-8dd8-f220deaeb5a1 · outbound

This paper cites Ac- cessed: 2025-02-11.

Distillation Scaling Laws Ac- cessed: 2025-02-11

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.703922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.833869Z digest=sha256:5f47845a84884f23f36fe931908fff76b6511d368d9f7776625afce7bb15fb7e

Observation d33897f2-e73e-469d-92dc-6f938b6374a2 · outbound

This paper cites Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data.

Distillation Scaling Laws Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-08-08T04:33:09.097480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.842135Z digest=sha256:9dabe4c156168a7b4b8ba359676cfa308280f384087a0fb2c2772ac19064584a

Observation b4c47448-072d-4586-af12-04ffd7ce7466 · outbound

This paper cites Deep Learning Scaling is Predictable, Empirically.

Distillation Scaling Laws Deep Learning Scaling is Predictable, Empirically

Reference 11

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.846677Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.846677Z digest=sha256:053020352cea7488d3d706955e8ede91b685dd86d86b62ddb399de19689513dc

Observation e701b72f-61a3-4382-a170-c53d77a6cfd5 · outbound

This paper cites URL https: //doi.org/10.1145/3458817.3476209.

Distillation Scaling Laws URL https: //doi.org/10.1145/3458817.3476209

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.860221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.860221Z digest=sha256:f2ab7ee5ae78af06c14e91fb98f76733cf50560afe675ad6b75a85a98639123a

Observation fb5b7d31-a71b-423a-8b56-6e6b2783af4e · outbound

This paper cites GPT-4 Technical Report.

Distillation Scaling Laws GPT-4 Technical Report

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.868098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.868098Z digest=sha256:33d4a31162027ad1441f7893372fde3785b4232c3f717ee624de496db66f31dd

Observation 4469a440-1847-4aa5-ae3c-20980ad64f8f · outbound

This paper cites Sakaguchi, K., Bras, R.

Distillation Scaling Laws Sakaguchi, K., Bras, R

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.880821Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.880821Z digest=sha256:23b32c11f7f6c5c30727f59120ab5e1b447422f8d88a2b7ddb0fe8a3a3d9dee0

Observation d722c0da-80ad-4efa-91bd-18acfe642a8b · outbound

This paper cites GLU Variants Improve Transformer.

Distillation Scaling Laws GLU Variants Improve Transformer

Reference 20

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.884623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.884623Z digest=sha256:dbfeefc17dabfedf9ccd0f73efe11a2e426478e4a026abd0cc9c022dfab5222e

Observation a8bdbfd2-4567-4c01-a144-96df8f736538 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Distillation Scaling Laws LLaMA: Open and Efficient Foundation Language Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.888374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.888374Z digest=sha256:965192091a0f30f041cf586e664b8b88ac6b7629f52ba34363ae34eb10098ae0

Observation ae19f48c-11d1-4419-8ce7-488269625b29 · outbound

This paper cites Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit.

Distillation Scaling Laws Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.892592Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.892592Z digest=sha256:5a281dc772d47135c251a46d9bf799a0592bf44ab969bd8c6ff0c6fc89e317af

Observation 27880ec8-32eb-4de6-87b0-6935a0c17ca4 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.667768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.906438Z digest=sha256:3c84a178c2ac382d387f2b3b393ad4764903ed7900c7162ba0538df52f026268

Observation f97e33fc-4cad-450a-9e1f-74c76420ac5f · outbound

This paper cites The second statement implies that the student should not be trained for too long, appearing to contradict patient teachers.

Distillation Scaling Laws The second statement implies that the student should not be trained for too long, appearing to contradict patient teachers

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.655816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.910439Z digest=sha256:b88a69d8333720d87b7514537ffb98858d0cbf1430a6d76d048877ef080c5582

Observation ab801d9b-2575-4ac7-88f3-3e2aa932a1cf · outbound

This paper cites (2022) do not see the teacher training distribution directly, whereas ours do.

Distillation Scaling Laws (2022) do not see the teacher training distribution directly, whereas ours do

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.643137Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.914347Z digest=sha256:16f6a83bf830d50b2165d8f372d24d65772946cdf74ff61459f6885103ee69f1

Observation 10300036-a0d0-4eda-91a3-0fd8cced1d25 · outbound

This paper cites The absence of a supervised baseline means that Beyer et al.

Distillation Scaling Laws The absence of a supervised baseline means that Beyer et al

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.630208Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.918968Z digest=sha256:28dcef6dc5e6a73112d3675596997b840fac95d7f829dea1a60777dbbb8113b3

Observation 7434c1b3-6f8a-46e1-8515-b763c858b8d2 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.617404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.924619Z digest=sha256:049419950f712011c17b728457fb7a476306b152d26f96402dae9cef2f200b40

Observation 6232092c-f886-4d6b-a4da-8c7f288b93aa · outbound

This paper cites Calibration against ground-truth.

Distillation Scaling Laws Calibration against ground-truth

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.605397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.928627Z digest=sha256:d5de53fceee7d7f0057139a59876ca5a5df2490c79172549c9594d310fa3ab6d

Observation af8cc276-2ebd-41de-90b5-11c2c4991b7d · outbound

This paper cites In Figure 43a, we observe that the student is well-calibrated against ground truth data.

Distillation Scaling Laws In Figure 43a, we observe that the student is well-calibrated against ground truth data

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.592707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.932536Z digest=sha256:e6ccb259fb231f95bd18bb2767abc8ddf70576882df5de639f1f8e901679c5e9

Observation 74dda7a2-8a3d-4dbc-89d7-e2eea1d93cd0 · outbound

This paper cites In Figure 43b, we see that a student trained only on its teacher’s top- 1 prediction, is not calibrated against ground truth data.

Distillation Scaling Laws In Figure 43b, we see that a student trained only on its teacher’s top- 1 prediction, is not calibrated against ground truth data

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.579687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.936630Z digest=sha256:ab112e2a8a1004ac300fba9eef51b31c9e6264cf7bfd299c89168f3d44c6d0a5

Observation 7588fe58-2692-4886-87f2-7dd936511498 · outbound

This paper cites We see in Figure 44a that when distilled from the full teacher distribution, the student is not calibrated against the teacher top-1.

Distillation Scaling Laws We see in Figure 44a that when distilled from the full teacher distribution, the student is not calibrated against the teacher top-1

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.565789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.940775Z digest=sha256:0d8fe6243901603481928b0441521e5db2c08ed80691dda7fa4d0bc13c551a7f

Observation 2b6e0cef-53e3-4096-b295-7c097ef841f9 · outbound

This paper cites In Figure 44b we observe that a student is distilled from its teacher’s top- 1 is calibrated with respect to teacher’s top-1.

Distillation Scaling Laws In Figure 44b we observe that a student is distilled from its teacher’s top- 1 is calibrated with respect to teacher’s top-1

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.552029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.944661Z digest=sha256:a47ffb0630679791291d5c8bdaaa61961da37c7748a20f611c3465709814173d

Observation 533b196c-f6b9-4838-990a-8a88f453416a · outbound

This paper cites In Figure 45a, we see that when the student is confident, it matches the teacher confidence.

Distillation Scaling Laws In Figure 45a, we see that when the student is confident, it matches the teacher confidence

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.537667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.948608Z digest=sha256:6076ffe0b82ccbae0c17855d88a96c848880fb64a7a6b87ae1fd60e828fa6dee

Observation 0129476a-52e3-4dfa-ab9f-c06f2e3cc103 · outbound

This paper cites In Figure 45b, for small teachers, we observe student overconfidence.

Distillation Scaling Laws In Figure 45b, for small teachers, we observe student overconfidence

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.524211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.952632Z digest=sha256:73a21ae3f32504f040ff257d677f710bbd0cc5bbefe623ff98915cec5afe5d57

Observation 9470eed0-8160-42ae-85c1-b31ac10b4a9f · outbound

This paper cites In Figure 45a we complete the picture from Figure 45a and see that the part of the distribution the student struggles to model is actually the place where teacher is most confident.

Distillation Scaling Laws In Figure 45a we complete the picture from Figure 45a and see that the part of the distribution the student struggles to model is actually the place where teacher is most confident

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.510816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.956574Z digest=sha256:957529eadab2df516028327baebd5b6691d56da77ecafb2508f77e4c22d9934e

Observation 1bbf89e8-9b3d-4028-a63c-7df71ec13445 · outbound

This paper cites log LT , −c0 log LT − c1f1 log 1 + LT d1 eLS 1/f1 ! + γ log A′ N α S + B′ Dβ S !# (48) = LSE.

Distillation Scaling Laws log LT , −c0 log LT − c1f1 log 1 + LT d1 eLS 1/f1 ! + γ log A′ N α S + B′ Dβ S !# (48) = LSE

Reference 38

Resolution
malformed identifier
raw_fallback, observed 2026-08-08T04:33:09.498103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.960334Z digest=sha256:278b0498a13ef0b11fd1a56bdcbb997e7a44e6b1aa4c7d7f9c6b1206282e3824

Observation 835a8686-e627-4015-9aa0-98d38a1660eb · outbound

This paper cites For all experiments, the English-only subset of the C4 dataset (Raffel et al., 2020) is used.

Distillation Scaling Laws For all experiments, the English-only subset of the C4 dataset (Raffel et al., 2020) is used

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.484714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-08-08T04:33:08.965380Z digest=sha256:dd15587654eb3e6bd0e8766ea851e134ab51c7985f52177b8ce5ff173b10f9f7

Observation f048f31d-d5af-4de3-ab61-f6cc1fcc0328 · outbound

This paper cites Textbooks Are All You Need II: phi-1.5 technical report.

Distillation Scaling Laws Textbooks Are All You Need II: phi-1.5 technical report

Reference 507

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.851423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.851423Z digest=sha256:c758624618e76b6323f8abe9872c6fa04e747db095f1a5fef5aef29519922c05

Observation fa8018af-c72d-45cd-8f50-81f75b32db0e · outbound

This paper cites GPT-4 Technical Report.

Distillation Scaling Laws GPT-4 Technical Report

Reference 2008

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.864303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.864303Z digest=sha256:82bf1833aaed9868082632dbbe13cf654340ec28ce16303ae57fa5a5c334725c

Observation 94421901-dfec-4354-90cc-edb3ed015057 · outbound

This paper cites Language models scale reliably with over-training and on downstream tasks.

Distillation Scaling Laws Language models scale reliably with over-training and on downstream tasks

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.837672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.837672Z digest=sha256:256c436ed9a42d9484ba4f7b6723572c289e7292ea054ac87145d98f1c166a43

Observation eaed84e0-cde7-4712-b087-ad4f596e14e9 · outbound

This paper cites A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs.

Distillation Scaling Laws A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.876380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.876380Z digest=sha256:db6f536464f412e4339978ac15dc693ed2e682211c6b9a8451df9bd5e22bb7e8

Observation 6e235190-ae06-4528-b3bb-e4a7a35310cf · outbound

This paper cites An Empirical Study of Scaling Laws for Transfer.

Distillation Scaling Laws An Empirical Study of Scaling Laws for Transfer

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.802494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.802494Z digest=sha256:2efccf19b4fdc3d27e167a3794e86f474151469347518194b2b9f752e2f85737

Observation 44a6deed-1c7c-4538-a331-55206dc97900 · outbound

This paper cites Why distillation helps: a statistical perspective.

Distillation Scaling Laws Why distillation helps: a statistical perspective

Reference 2022

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.855974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.855974Z digest=sha256:8804d73d41396bd20ecbf833d1c0c627d5884ae84a4a737e71add4151bdd68bb

Observation a8f55bd0-0c78-4cc7-ba78-957cb1dfe77b · outbound

This paper cites The Calibration Generalization Gap.

Distillation Scaling Laws The Calibration Generalization Gap

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.816244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.816244Z digest=sha256:cc6a883734282d6f3d27c9a1f19b727042333b4647a1abac409f105409a88f9f

Observation 405b5901-2f94-4530-892e-a0a92d1feb18 · outbound

This paper cites Resolving Discrepancies in Compute-Optimal Scaling of Language Models.

Distillation Scaling Laws Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.872000Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.872000Z digest=sha256:76be80e7b6a54ccc005a64b2887a8ad0faab8ffe4833cc46d1fbe92a4e40d69c

Observation 4daaa6fc-522e-4808-8158-03e0f1b67c47 · outbound

This paper cites The Elements of Differentiable Programming.

Distillation Scaling Laws The Elements of Differentiable Programming

Reference 6239

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.811647Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.811647Z digest=sha256:2a4a96a8e77b708c9cfc25f8c1f62df1b117997f472a6fdf5edd6435eb5381a7

Observation 8a13c364-577a-4170-b639-b970af5e257d · outbound

This paper cites doi: 10.1609/AAAI.V34I05.

Distillation Scaling Laws doi: 10.1609/AAAI.V34I05

Reference 7439

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.807626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.807626Z digest=sha256:92a710d4fffc3f5dedb15204a22a58146614346e0e3d2c82f1975d98ed303fef

Pith citing papers

Observation b5fcae33-acec-4db6-9ccd-5987bbece965 · inbound

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models cites this paper.

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models Distillation Scaling Laws

Reference 60

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T08:40:41.236055Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-12T08:40:40.910461Z digest=sha256:c3e252e9d3552a5e87c01d06a3345a52ed2c15ae013818b2933cfd203d9a8b6f

Observation cb9b0894-42ac-4dd9-9639-356e2dfd57cc · inbound

HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling cites this paper.

HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling Distillation Scaling Laws

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T13:53:44.547375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:53:44.547375Z digest=sha256:d0c70b0175e8f343dbad31de9fd592dfab6816f239e8b8df2adf8b1888295a0a

Observation dfff7ebc-db84-4914-b3a8-c73ab38c162a · inbound

Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles cites this paper.

Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles Distillation Scaling Laws

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T13:21:04.584884Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:21:04.584884Z digest=sha256:adea7b74fa6f286322ee4d8a0a7ce4eda87cb158eae745dad066bcfc234afdb7

Observation 7e70aa5e-28f4-4b46-9fbd-1b76d123f189 · inbound

SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought cites this paper.

SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought Distillation Scaling Laws

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T12:39:02.284171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:39:02.284171Z digest=sha256:5dd335bc49c872de44a9260ede8a1f7811806b412711d1d825c1eec7e236de0f

Observation 948fd68b-e593-4bce-a013-72f891ed1cd4 · inbound

A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search cites this paper.

A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search Distillation Scaling Laws

Reference 101

Resolution
unresolved
no resolver link, observed 2026-08-07T05:07:39.912256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:07:39.912256Z digest=sha256:f9373b1bbe03a1fb52b69ca307e184f8ef92c1b50fef5a06cf6bf73ed2b0e795

Observation f6f109e9-a66f-4efa-9756-7de207a2c72b · inbound

Language Models Improve When Pretraining Data Matches Target Tasks cites this paper.

Language Models Improve When Pretraining Data Matches Target Tasks Distillation Scaling Laws

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T16:53:08.909525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:53:08.909525Z digest=sha256:9ca92f1b023e566590188f27d849a18a6fb04e0e3f422cd9463106caab36739e

Observation d9287584-c60c-4e1f-b10f-1b5121db1396 · inbound

Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling cites this paper.

Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling Distillation Scaling Laws

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-05T12:25:24.197937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T12:25:24.197937Z digest=sha256:f4260d7078e2af6a839aacc8088c9d28072428362e865a97dc48a347cbb86544

Observation ab8ee03a-23fd-4e68-b2f7-9b4d65595187 · inbound

Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe cites this paper.

Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe Distillation Scaling Laws

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-11T11:11:06.799350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-10T15:05:41.683722Z digest=sha256:9a59868025d3be2265932b215fc117144a25f40f1284062b3e3d6d9ead2e3484

Observation 06a08037-217e-476e-95c0-49f6b5cc9295 · inbound

Attention to Mamba: A Recipe for Cross-Architecture Distillation cites this paper.

Attention to Mamba: A Recipe for Cross-Architecture Distillation Distillation Scaling Laws

Reference 4

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T23:08:25.019226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-05-13T23:07:41.022051Z digest=sha256:bb659321cae9433965dcc4e2194de3d144178377f01c5f10f9f6a711df9afa96

Observation 7abbae8a-218a-41bf-bba6-22ca9e906757 · inbound

Locking Pretrained Weights via Deep Low-Rank Residual Distillation cites this paper.

Locking Pretrained Weights via Deep Low-Rank Residual Distillation Distillation Scaling Laws

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:16:28.199224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-05-12T04:26:13.390232Z digest=sha256:6130de4d9b1d87af89ab70ca89fa5c81597640bac63318c034de20adcb3fc752

Observation d6c8bdd3-d23d-4fed-8f2d-34dcd0fc7638 · inbound

Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why cites this paper.

Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why Distillation Scaling Laws

Reference 31

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:11:27.194571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-05-12T04:28:58.679078Z digest=sha256:9a26a02fe38383bfd4aa710121b2799bb6933f2c8dff051e53d1f9a99ad1d5a0

Observation 116a3b02-0a7b-4e60-9c4a-882954ad9686 · inbound

GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets cites this paper.

GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets Distillation Scaling Laws

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-20T12:28:16.839876Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-05-20T12:25:39.417436Z digest=sha256:d76bb077e9fb55fbfd9908fa53e1197e0af1a27a83031d20a34efc9f759e0589

Observation 808a10a8-30b8-44f4-979b-5d8fad005d58 · inbound

A Primer in Post-Training Reasoning Data: What We Know About How It Works cites this paper.

A Primer in Post-Training Reasoning Data: What We Know About How It Works Distillation Scaling Laws

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-07-01T23:06:20.492970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-06-28T14:40:21.583101Z digest=sha256:b955121dfa6cb5ba2b29949dddb66d734f93cab9fcec3b18844c92ae801ea800

Observation bd734d7d-d47f-4d95-b659-cdcf0c08842e · inbound

Scaling Laws for Task-Specific LLM Distillation cites this paper.

Scaling Laws for Task-Specific LLM Distillation Distillation Scaling Laws

Reference 15

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T17:40:00.709298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-06-25T23:29:49.787477Z digest=sha256:8522b0cad34f4223a276ac07d8e2ac3dbf5712194d259b8c663839e3b64c97d2

Observation 43781904-f825-4a0a-ba1a-65d06731e5ba · inbound

DOPD: Dual On-policy Distillation cites this paper.

DOPD: Dual On-policy Distillation Distillation Scaling Laws

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-06-30T05:54:18.565205Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-06-30T05:51:18.037199Z digest=sha256:d484e8487cb790086b467f1d180f9515ed23231eb68e1df2e53fadd51d690279

Observation eccf6957-144f-434b-a8d0-1342b8625d63 · inbound

When Does Generating More Help? Disentangling Fixed-Source Synthesis from Source Expansion in Synthetic Data Scaling cites this paper.

When Does Generating More Help? Disentangling Fixed-Source Synthesis from Source Expansion in Synthetic Data Scaling Distillation Scaling Laws

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-03T15:28:33.813041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-07-03T15:20:51.474398Z digest=sha256:05d871f9e4be4cc3b0d2094471d957a09f1b0fa6b5d69c885df7a96bbffa58ba

Observation fcfc1f1d-28b0-4845-8f6b-20e29d53e00e · inbound

Weak-to-Strong Generalization via Direct On-Policy Distillation cites this paper.

Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws

Reference 30

Resolution
verified exact
local_arxiv, observed 2026-07-07T12:33:45.193910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-07-07T12:31:42.224094Z digest=sha256:bf9c7f57ac26c8001f6f5dc607a79a537d2d6ca0e4f435a4ebcb10159857cd56

Observation 39e87fb7-d8c1-4488-a56e-e9092c417205 · inbound

Weak-to-Strong Generalization via Direct On-Policy Distillation cites this paper.

Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws

Reference 30

Resolution
unresolved
no resolver link, observed 2026-07-11T07:01:56.628017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T07:01:56.628017Z digest=sha256:cee236076c67fb96e9c9ea45ccdef05c523f5b8a7186e7d12ab22d595ff79b82

Observation 4f71c4fa-1ba9-4e75-b09b-d704595675a3 · inbound

Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment cites this paper.

Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment Distillation Scaling Laws

Reference 15

Resolution
metadata mismatch
local_arxiv, observed 2026-07-10T10:27:02.465940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=pdf_text observed=2026-07-10T10:20:46.103409Z digest=sha256:3790e6aa5fbb4ee108bb5c842e16a0041be7a218d88351e108b60c1d72ac19c7

Observation a26b1bb5-02e4-49c1-9467-463b64384223 · inbound

Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals cites this paper.

Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals Distillation Scaling Laws

Reference 35

Resolution
unresolved
no resolver link, observed 2026-07-14T05:09:00.865375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T05:09:00.865375Z digest=sha256:bb247c39dc06266cc766c7ec4401d4dcd4971bab42d7092f461c35066acdd4ae

Observation 57a20919-bb17-49a2-b72b-4a46b27889ec · inbound

Bridging Compute- and Data-Optimal Pretraining cites this paper.

Bridging Compute- and Data-Optimal Pretraining Distillation Scaling Laws

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-01T03:02:01.509903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T03:02:01.509903Z digest=sha256:991f6344e8173581e7d5ab2639c169f483494d1d0d4056c5affac1a071e415a3

Observation 755b5046-0fc4-408f-aec7-31f6ec3e78b5 · inbound

Skaling: Chinchilla's Exponents Meet Kaplan's Coupling cites this paper.

Skaling: Chinchilla's Exponents Meet Kaplan's Coupling Distillation Scaling Laws

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-10T12:32:57.249732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:32:57.249732Z digest=sha256:a384ca07c8a9b670b4d2c3ff55bd5b9a80631fab78afa266342d03c39ecaa521