Pith. sign in

Paper Citation Record · LEDGER

A Controlled Study of Attention-Only Transformers

As of 13 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 0 inbound Pith citation observations for arXiv:2607.18363.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.18363 v1

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-01T16:19:08.235961Z

measured 34 of 34 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

34 of 34 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved34
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 01d8864c-cdfd-4dec-90aa-8aed6ec39fdc · outbound

This paper cites ReZero is All You Need: Fast Convergence at Large Depth.

A Controlled Study of Attention-Only Transformers ReZero is All You Need: Fast Convergence at Large Depth

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.119127Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.119127Z digest=sha256:2e73518a7c3785425d882dab809b9e52b31323bfe6e3032285316ddf705df06a

Observation 7a01a720-bc6b-4cd4-bab5-edf076a95335 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.124671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.124671Z digest=sha256:4e955614fc069da537a3e2b43da0b6ae958b26ac18db2518545a4bc921952820

Observation 2e6abb71-5b85-4b4d-81f9-12eeb61a8872 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.127792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.127792Z digest=sha256:2a9eb6b0f02551b465417d0acfa7b9120b5a85894d519c53922ebb54e3af1ccb

Observation 44054583-ff97-412f-aafe-3b59fab30270 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.130563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.130563Z digest=sha256:655e17c7404a328735110c501e00680bbcd7c7d1a2bb7e3f6aae53dd2c8c938a

Observation be7cde6b-64e9-4b77-8a0d-5741bffe1c42 · outbound

This paper cites TinyStories: How Small Can Language Models Be and Still Speak Coherent English?.

A Controlled Study of Attention-Only Transformers TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.134393Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.134393Z digest=sha256:045fc176ae05fb8ccef4722afbde99636938888780557c76e1f1dd5b7b9c0761

Observation 3e888fe0-e43d-414f-96f7-9cfd7a1b64e7 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.138144Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.138144Z digest=sha256:2d61cf39d38bee5865674ce9eb5b468b81e84ac13de0bc4d8a2eab52c2beb1d0

Observation af7c72a5-4d8c-467a-9630-ae09ecc31938 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.140916Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.140916Z digest=sha256:18dd71966f9ff24913cdd717e892de27747c50fa8f587f7c4a970f96db26f032

Observation d31f6c9c-db37-4177-9f63-edf74f9003a5 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.144043Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.144043Z digest=sha256:212a9c4f9c004d8a2a52e580711ce9f22e8abc5841dbef3d10f6de8c9d3858f5

Observation 87f124c0-9415-4edd-a977-9d9e0ce9fda2 · outbound

This paper cites R.; and Goldberg, Y.

A Controlled Study of Attention-Only Transformers R.; and Goldberg, Y

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.147647Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.147647Z digest=sha256:6db935b8765e663379a80a87112b46202323966d6938afa414968ee5145588a7

Observation e64cfa6c-8878-4c6b-82b6-3306c4986849 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.151039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.151039Z digest=sha256:51f9de77ba64c94e0f013d052239478b60c78e405e20edd64d27eac44acf0345

Observation f29f0518-45da-4a77-9df8-064696c3936c · outbound

This paper cites Textbooks Are All You Need.

A Controlled Study of Attention-Only Transformers Textbooks Are All You Need

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.154646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.154646Z digest=sha256:636a5bd92ac032fedac3593fe55f4ab71cd7791af510fc83acecda019baec643

Observation 3b1182b1-e064-4877-b26e-8e7af8652a20 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.158217Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.158217Z digest=sha256:84bdb6f8ac8f6560bc41e8a737610d7a1f03ec5ae9a9c3f78d677712edee25ac

Observation 0097fa11-bdfa-4d6a-98b4-327f8727d71a · outbound

This paper cites R.; Pawar, S.

A Controlled Study of Attention-Only Transformers R.; Pawar, S

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.161398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.161398Z digest=sha256:31091af981088b560bc753cae1f6e32ba86d0d6ee28eb83c5726b26e2c3386f5

Observation 156d6003-cfd3-4d90-86b7-1e6e083aefc6 · outbound

This paper cites Training Compute-Optimal Large Language Models.

A Controlled Study of Attention-Only Transformers Training Compute-Optimal Large Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.164754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.164754Z digest=sha256:4e0646d72c8e6f7dc795bfd92678f76521413488027a20d55322cd670c6ce5de

Observation 239f33e3-a187-4e04-844a-6ac2eb163f7c · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.168033Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.168033Z digest=sha256:b9bf2c3ab50fb8784b26cc30bd03a4a1c01e69d77ec435b64aa9be6e400afd77

Observation 7a5f1240-2c4a-4bc0-b1a2-64068c2353d8 · outbound

This paper cites Attention Residuals.

A Controlled Study of Attention-Only Transformers Attention Residuals

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.171765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.171765Z digest=sha256:07c217cfb770f187bbf278a231dc10ec3ac5a045164be705e2fff84fbb75b25f

Observation e35142ff-7e41-4e05-b84c-af6ba7aeeced · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.175679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.175679Z digest=sha256:e3defc69da959af31d565a8cabaa6152bf7b3dec4c1f86fe014d63f15ff84b87

Observation 2e818dd8-e58d-4b51-92ae-c0c5671b8549 · outbound

This paper cites Muon is Scalable for LLM Training.

A Controlled Study of Attention-Only Transformers Muon is Scalable for LLM Training

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.179609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.179609Z digest=sha256:6abd88c009cd3fbde11e7f4eaca7d3a7dda5de1d883310c8396d8e6c0540fa9a

Observation d1281351-c259-4c9a-9ef3-4b3795e299aa · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.183501Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.183501Z digest=sha256:b5d4ca421a3b1316975a810a44e3a9626e97e5b431305e88e46aa9ff78cb76e6

Observation a256b572-2889-45e2-b146-b51140f86932 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.186824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.186824Z digest=sha256:238b4206314640514899d0ac32446069312758f3cb48830dbce0e91465778c86

Observation a2a9f0d6-7c0f-4282-8a42-5a6191e1559a · outbound

This paper cites M.; Barak, B.; et al.

A Controlled Study of Attention-Only Transformers M.; Barak, B.; et al

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.190481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.190481Z digest=sha256:60d366ea0b9df0402d7edad1542aa84a74a29eb7a22abe44d142dec2053cb21c

Observation 1006c1d9-bad7-4dcc-a185-12ec96f7541a · outbound

This paper cites P.; and Lucchi, A.

A Controlled Study of Attention-Only Transformers P.; and Lucchi, A

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.193925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.193925Z digest=sha256:662b28509091f2b7937f68a8c8cec2da4bfb3508cce570135677e60ac63b041e

Observation cccbd053-020a-4231-83ff-e6e1630dc687 · outbound

This paper cites 2 OLMo 2 Furious.

A Controlled Study of Attention-Only Transformers 2 OLMo 2 Furious

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.196447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.196447Z digest=sha256:562bbdbf7cc3f9688e0897cd218d20c828b64831aac3177bd39ecc037517de12

Observation a867fda9-e0b4-4f6c-a5ee-d9bccb8c1f5b · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.200149Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.200149Z digest=sha256:f4a7c9865dc3fb372898bd71bcf941e28cb27544a5b58ac48f078c1f89744fe4

Observation 8df6319e-6934-40e5-9719-c54a8795bca8 · outbound

This paper cites The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale.

A Controlled Study of Attention-Only Transformers The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.203450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.203450Z digest=sha256:1e9ecb1c5f48ed8ace285e900c0a392ecb37cdef8a9c81eb925bee17cd6056ea

Observation 95fe18b6-76b6-49b1-ac50-1c542731b099 · outbound

This paper cites One Wide Feedforward is All You Need.

A Controlled Study of Attention-Only Transformers One Wide Feedforward is All You Need

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.208016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.208016Z digest=sha256:208e24d19f50535093e31f071dc0296aabcd784ea80e1d5867fd632694be3e14

Observation c059e942-5f80-402d-8835-8de7550a53ec · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.211479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.211479Z digest=sha256:fb73622d8e89ea13e09b1b95eab16ea2502704e7466d188a2c1a205f7304c4d7

Observation 07381105-25cd-4c2f-92b9-32f906cf5671 · outbound

This paper cites Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free.

A Controlled Study of Attention-Only Transformers Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.214613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.214613Z digest=sha256:e04a54549a7bb612aede5b5c34ee5811575488581c7d4c8f78aa30d33f76f007

Observation 8af19852-f78d-43d3-a532-5a2890762fd4 · outbound

This paper cites NormFormer: Improved Transformer Pretraining with Extra Normalization.

A Controlled Study of Attention-Only Transformers NormFormer: Improved Transformer Pretraining with Extra Normalization

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.218424Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.218424Z digest=sha256:e6f4017e766416b51d5b4b9c8adedbcff23aa66e6cab2ea05dbcca7a9d87f3e0

Observation 07c5afb5-acdd-48e2-b163-0265439698b5 · outbound

This paper cites Highway Networks.

A Controlled Study of Attention-Only Transformers Highway Networks

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.221318Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.221318Z digest=sha256:1a8d33c8122ac0de8571a33071894692811521d49401ca2d80d19cc7858d469b

Observation 227efa58-26d5-4576-88fc-adfb429b8d2f · outbound

This paper cites Augmenting Self-attention with Persistent Memory.

A Controlled Study of Attention-Only Transformers Augmenting Self-attention with Persistent Memory

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.224718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.224718Z digest=sha256:f136db8a30af2d5a49b2b955c57f93cd5d955d1506626122cce4626e2e0f5b40

Observation c940066d-3e84-446d-a760-5ca82692eb75 · outbound

This paper cites O.; Houlsby, N.; Kolesnikov, A.; et al.

A Controlled Study of Attention-Only Transformers O.; Houlsby, N.; Kolesnikov, A.; et al

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.228844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.228844Z digest=sha256:71cc880448d16c7708138ae3e965504f90c19412116db46a00d50cafe37e9d97

Observation 0e7dc9ab-59cb-4ba5-896d-b45c9b9b9640 · outbound

This paper cites N.; Kaiser, .; and Polosukhin, I.

A Controlled Study of Attention-Only Transformers N.; Kaiser, .; and Polosukhin, I

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.232302Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.232302Z digest=sha256:99110edc8d13e5fa5f634a7276c8d2f1b62695175953911a7e0975f7ae8e8560

Observation 82f9ca7f-15fc-45c6-9f37-a29da5af75f5 · outbound

This paper cites an unresolved cited work.

A Controlled Study of Attention-Only Transformers Unresolved cited work

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-01T16:19:08.235961Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T16:19:08.235961Z digest=sha256:29e70f1d970ab4787bd069c592a4b55f364cfc905b7bf3d7bb9bb7aa72973a9a

Pith citing papers

No inbound Pith citation observations are available.