Pith. sign in

Paper Citation Record · LEDGER

Extrapolation by Association: Length Generalization Transfer in Transformers

As of 9 August 2026, this Paper Citation Record lists 50 of 50 outbound references and 4 inbound Pith citation observations for arXiv:2506.09251.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.09251 v2

Coverage vector

measured 50 of 50 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:59:24.796012Z

measured 54 of 54 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T17:31:45.986659Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-30T07:34:21.663944Z

Reference resolution

50 of 50 outbound references displayed

  • verified exact3
  • verified fuzzy6
  • unresolved41
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 33880408-792c-4816-8f9c-0f58a1f37073 · outbound

This paper cites Task Generalization With AutoRegressive Compositional Structure: Can Learning From $D$ Tasks Generalize to $D^{T}$ Tasks?.

Extrapolation by Association: Length Generalization Transfer in Transformers Task Generalization With AutoRegressive Compositional Structure: Can Learning From $D$ Tasks Generalize to $D^{T}$ Tasks?

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.162242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.162242Z digest=sha256:a1bdf73622aab6f210845f2ac504ba7acce8213e1b036bb5f7ef35193ca81533

Observation 37f88e86-24ab-43d2-b78f-0a377425a6c1 · outbound

This paper cites On Provable Length and Compositional Generalization.

Extrapolation by Association: Length Generalization Transfer in Transformers On Provable Length and Compositional Generalization

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.234971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.234971Z digest=sha256:c3636f53457bdd97f35ada7612e4f25b93b506f2956fbc1c6b9b02e6d362d41b

Observation 76ad8a4a-f215-403e-9aa7-52eaf28a75bb · outbound

This paper cites Llama 3 model card.

Extrapolation by Association: Length Generalization Transfer in Transformers Llama 3 model card

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.308611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.308611Z digest=sha256:1777098df4225117cf8d4b418c065361f43f56ecdf2f4dd543b81d68b8e5cdec

Observation 7f765904-2d86-4ee7-a0e0-0b94ac480286 · outbound

This paper cites Smollm - blazingly fast and remarkably powerful, 2024.

Extrapolation by Association: Length Generalization Transfer in Transformers Smollm - blazingly fast and remarkably powerful, 2024

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.373781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.373781Z digest=sha256:ea08132b41224be4aa038915226e95d865f197d3c29bafd61f2dccf5babfa9b4

Observation 7bfd8e7f-34d0-40cf-b64a-b39116e64054 · outbound

This paper cites Exploring length generalization in large language models.

Extrapolation by Association: Length Generalization Transfer in Transformers Exploring length generalization in large language models

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:27.317484Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:20.440034Z digest=sha256:9afc9d4a2e484cc9d3e087d1f74769b49245999fa9fc2985b30c7ec8b8d2d8a9

Observation 47a34764-6462-4a1d-88a4-bdfcc550539b · outbound

This paper cites Zoology: Measuring and Improving Recall in Efficient Language Models.

Extrapolation by Association: Length Generalization Transfer in Transformers Zoology: Measuring and Improving Recall in Efficient Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.526214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.526214Z digest=sha256:5da8619d5fe3227789891452edb83f61a4913dccc67996e5ca7d891a1a8c5203

Observation 8bb30264-8fc4-4369-ab57-fb6def66075d · outbound

This paper cites Improving Length-Generalization in Transformers via Task Hinting.

Extrapolation by Association: Length Generalization Transfer in Transformers Improving Length-Generalization in Transformers via Task Hinting

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.605543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.605543Z digest=sha256:466000a4a7decfaeb5a3b4c478f75df0d7e3aa75462abe5deafb07eedadb19e2

Observation b785543a-3f2d-4b0b-9d52-3814a2b71986 · outbound

This paper cites Round and Round We Go! What makes Rotary Positional Encodings useful?.

Extrapolation by Association: Length Generalization Transfer in Transformers Round and Round We Go! What makes Rotary Positional Encodings useful?

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.725757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.725757Z digest=sha256:7fd43c511fa594bbfa0d6c5621a15efb2d31ea9b15462cc4159b4970f193369a

Observation 82b13d89-1707-4373-9f77-1f4068a3200e · outbound

This paper cites Language Models are Few-Shot Learners.

Extrapolation by Association: Length Generalization Transfer in Transformers Language Models are Few-Shot Learners

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.841712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.841712Z digest=sha256:42f83f5040cc8abad34a8e7fec4153466340a75cc0bfec0b0c668b7216258de4

Observation 7ca67220-9220-4ba3-9a23-a8377b262c95 · outbound

This paper cites Curve circuits.

Extrapolation by Association: Length Generalization Transfer in Transformers Curve circuits

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:20.947101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:20.947101Z digest=sha256:b0e93f7db50e82dab71a1ea061070028b6959c6e11140682f1c0f326011bb777

Observation 465d7395-ede9-48cd-ba1a-71919f036cde · outbound

This paper cites Position coupling: Improving length generalization of arithmetic transformers using task structure.

Extrapolation by Association: Length Generalization Transfer in Transformers Position coupling: Improving length generalization of arithmetic transformers using task structure

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:27.166261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:21.090602Z digest=sha256:90fb2e4dd5901ee0e86e38df8afe9915eabedf8e99bc7370f08a77271cb410af

Observation 9e830576-616b-49fb-9094-4eeb6c2afa7f · outbound

This paper cites LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens.

Extrapolation by Association: Length Generalization Transfer in Transformers LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:21.226822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:21.226822Z digest=sha256:712d8d89d80a6a06950413ef401a4510aa2dae20ee58b9189ceaeaadb4948229

Observation 3b8ccece-5595-4f9a-aa71-5b9018ad33a7 · outbound

This paper cites From Interpolation to Extrapolation: Complete Length Generalization for Arithmetic Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers From Interpolation to Extrapolation: Complete Length Generalization for Arithmetic Transformers

Reference 13

Resolution
verified exact
local_arxiv, observed 2026-08-07T04:59:25.699231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:21.351391Z digest=sha256:9022f5d627b73f67e5fe9daaaeeee2617a9ec584280ca068cecf5b623abef0c8

Observation 77160230-375d-4ef1-94e4-34081a613dcb · outbound

This paper cites Location Attention for Extrapolation to Longer Sequences.

Extrapolation by Association: Length Generalization Transfer in Transformers Location Attention for Extrapolation to Longer Sequences

Reference 14

Resolution
verified exact
local_arxiv, observed 2026-08-07T04:59:25.418045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:21.454529Z digest=sha256:6f7eb755434678890245327a64033308d7d6422c5828e295aad2eedaa1126e7f

Observation de2c2496-8001-4cab-a1ad-e9330e8993f2 · outbound

This paper cites Looped Transformers for Length Generalization.

Extrapolation by Association: Length Generalization Transfer in Transformers Looped Transformers for Length Generalization

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:21.582522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:21.582522Z digest=sha256:8ce3a69094753faeeb4f92b28a58bcad29f2f3c697231a0c5765308d43a201d8

Observation c7b13c42-d2cb-4235-a72f-e888ac8e96c1 · outbound

This paper cites Not All LLM Reasoners Are Created Equal.

Extrapolation by Association: Length Generalization Transfer in Transformers Not All LLM Reasoners Are Created Equal

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:21.688065Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:21.688065Z digest=sha256:09ccf839b4db8589bbfd663f323c76c2ffae21cf2edf44a9d4463820f8bdf757

Observation fc852dff-426e-4d09-a978-a6c5c21eddb2 · outbound

This paper cites Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67: 0 757--795, 2020.

Extrapolation by Association: Length Generalization Transfer in Transformers Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67: 0 757--795, 2020

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:26.939238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:21.814807Z digest=sha256:78f65fba58eed60ad31a0cfae9fb4d38b4cf4696d210cb4489d17f5d08729d04

Observation 37578f20-fd25-41b8-b168-17889a1cf32d · outbound

This paper cites The impact of positional encoding on length generalization in transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers The impact of positional encoding on length generalization in transformers

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:21.964867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:21.964867Z digest=sha256:b07a178b8faa3a47d689c36b80fc0d4a5b850dad1df3b28e2f6c8e6bf05e6cc1

Observation a0b6e6fa-3f8f-4697-9da3-2b0f4fe85944 · outbound

This paper cites Teaching Arithmetic to Small Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers Teaching Arithmetic to Small Transformers

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.085667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.085667Z digest=sha256:7f3f50aece491bc10b169d8abcd158c23e59b06a6236a89dcd1290026588e857

Observation 9b37e4b3-07c9-4abc-aac8-65761039cf7c · outbound

This paper cites Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges.

Extrapolation by Association: Length Generalization Transfer in Transformers Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.214156Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.214156Z digest=sha256:b9467b2373f02b8eb98e91e0a85578c388ef5ae84e00a54c01ac938fa728be49

Observation ea75c76d-bdba-493b-842f-d864e0d628d9 · outbound

This paper cites On the power of convolution-augmented transformer.

Extrapolation by Association: Length Generalization Transfer in Transformers On the power of convolution-augmented transformer

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:26.698960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:22.338046Z digest=sha256:a71ca07ef7d52134bc6ce10ce2696f177c0664d8a6d9001047a4d8ac315f232d

Observation bbc82434-d7c4-414f-b00d-fa18c849919f · outbound

This paper cites Functional Interpolation for Relative Positions Improves Long Context Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers Functional Interpolation for Relative Positions Improves Long Context Transformers

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.439576Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.439576Z digest=sha256:bdac3351697afe2ca31a599d87fb188977738b8bb05ce5207bccacae6039125d

Observation ec53643b-0ec3-463e-8512-a7b65201e533 · outbound

This paper cites Transformers Can Do Arithmetic with the Right Embeddings.

Extrapolation by Association: Length Generalization Transfer in Transformers Transformers Can Do Arithmetic with the Right Embeddings

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.551425Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.551425Z digest=sha256:02095e7288ea8213e6c1aac1cbb54d4077022e94d558300e22905d545556c460

Observation 7fa88278-8f65-4253-9aca-a6bcd8680afd · outbound

This paper cites The EOS Decision and Length Extrapolation.

Extrapolation by Association: Length Generalization Transfer in Transformers The EOS Decision and Length Extrapolation

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.652718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.652718Z digest=sha256:782e4cf803f45b2bc2acb4e278e8c56d01661f7a90348c9e3ac41c7117ad37b2

Observation fa7483f7-0633-45e2-b450-6e51f0abe355 · outbound

This paper cites In-context Learning and Induction Heads.

Extrapolation by Association: Length Generalization Transfer in Transformers In-context Learning and Induction Heads

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.798473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.798473Z digest=sha256:355d16be8ee50975ff2234653f797a95407592d51566f1f7e35e368c1dd3a98c

Observation 9ff12991-e5ea-4e52-b7de-3a961811a456 · outbound

This paper cites GPT-4 Technical Report.

Extrapolation by Association: Length Generalization Transfer in Transformers GPT-4 Technical Report

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:22.903100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:22.903100Z digest=sha256:65ec521e660878b70a91b7a6edf9545f787df20acea1cf0677e337c0de8115f1

Observation b8944dab-d489-47cc-947f-2cd86631af48 · outbound

This paper cites YaRN: Efficient Context Window Extension of Large Language Models.

Extrapolation by Association: Length Generalization Transfer in Transformers YaRN: Efficient Context Window Extension of Large Language Models

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.012533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.012533Z digest=sha256:0aa272c4436a93bdc33aecd6e92dc895228af4aeeb30b395fbb0d6a75a1bf796

Observation 416a25d7-da85-47df-b2a8-9a0c155093ee · outbound

This paper cites Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation.

Extrapolation by Association: Length Generalization Transfer in Transformers Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.097510Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.097510Z digest=sha256:c884f2bb215749144102587c6eb782dbc4105f333ffc8c253c70465af2b1e331

Observation 0a6dd0fc-2ec8-49df-b36d-685a7f6506f8 · outbound

This paper cites Understanding Addition in Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers Understanding Addition in Transformers

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.183727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.183727Z digest=sha256:7909d34e8294c777d9aff1635d9bef156db7fde964b313861104cf2db3b4dcf8

Observation 49e6a529-0013-4ec1-a89d-15310ee7de78 · outbound

This paper cites Understanding Addition and Subtraction in Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers Understanding Addition and Subtraction in Transformers

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.268938Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.268938Z digest=sha256:5d55da4a0729eb84aed631b939f0d0d0dd57a9030fb257e7182945d5348f6430

Observation b78d701f-0376-4daa-9a6e-8a75baf8af62 · outbound

This paper cites Compositional capabilities of autoregressive transformers: A study on synthetic, interpretable tasks.

Extrapolation by Association: Length Generalization Transfer in Transformers Compositional capabilities of autoregressive transformers: A study on synthetic, interpretable tasks

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:26.507125Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:23.370958Z digest=sha256:19587c891db60a8a56a0c4abaa30a7aeed5b2919dc5477a2f2e5503d2b4a0279

Observation 95a3bfde-2e81-43cf-a132-86c6989a957d · outbound

This paper cites Randomized Positional Encodings Boost Length Generalization of Transformers.

Extrapolation by Association: Length Generalization Transfer in Transformers Randomized Positional Encodings Boost Length Generalization of Transformers

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.490891Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.490891Z digest=sha256:8106f047735542cab07a3750812020341cc2df543f611d325ef1bb7cb6fb5a03

Observation 0d1d0ade-6547-41b4-9726-06fefd1abf76 · outbound

This paper cites Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks.

Extrapolation by Association: Length Generalization Transfer in Transformers Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.494086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.494086Z digest=sha256:2064d8f75ca7b2c8221b9caa458fd313539a874b7979d9fa0706413fe0ad9a3b

Observation f379a385-fef3-436b-a249-b43435063d3f · outbound

This paper cites Multitask prompted training enables zero-shot task generalization.

Extrapolation by Association: Length Generalization Transfer in Transformers Multitask prompted training enables zero-shot task generalization

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.497635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.497635Z digest=sha256:41d228412812041f77fc6a6ccf75d5c83505f9895b28c571d2984046419b5fd3

Observation 7a215239-c687-43aa-aaaa-b184527bfd3f · outbound

This paper cites Positional Description Matters for Transformers Arithmetic.

Extrapolation by Association: Length Generalization Transfer in Transformers Positional Description Matters for Transformers Arithmetic

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.504423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.504423Z digest=sha256:54e3ed5139b7325ac57d21454253f2af9d88504045480de125dcc50c94cceda4

Observation 82ea1acf-e236-4a76-a936-31c7952b4cda · outbound

This paper cites RoFormer: Enhanced Transformer with Rotary Position Embedding.

Extrapolation by Association: Length Generalization Transfer in Transformers RoFormer: Enhanced Transformer with Rotary Position Embedding

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.570697Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.570697Z digest=sha256:17bb5a5ebcbcd23ebd9e96958b8dc805030e605cc7655f8d92579f01acb2df1f

Observation f79164a6-a64d-4590-95be-a8493a301f24 · outbound

This paper cites Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small.

Extrapolation by Association: Length Generalization Transfer in Transformers Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.693310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.693310Z digest=sha256:1df8039b8d7d30b8a318e7be418ed4c6482148522aa33ddba487634db8b2b8d2

Observation e86f633f-8665-4e17-946b-9ef729a0dc7b · outbound

This paper cites Emergent Abilities of Large Language Models.

Extrapolation by Association: Length Generalization Transfer in Transformers Emergent Abilities of Large Language Models

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.764596Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.764596Z digest=sha256:ed9bf23de43f0a59f2271684631d12f0051329903fdc129691d4a7e0a00fffe5

Observation d4d1d9ed-c6fb-4f9f-bf7c-bc19e82dd2cd · outbound

This paper cites Generating random spanning trees more quickly than the cover time.

Extrapolation by Association: Length Generalization Transfer in Transformers Generating random spanning trees more quickly than the cover time

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.829882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.829882Z digest=sha256:0c6e93fd014cbf3f4c89e215f0758d75af1927d6b080208fed1330fb420ee5b0

Observation 12ae6f7c-46ad-47ad-ba03-f62dfd1dbf5a · outbound

This paper cites Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability.

Extrapolation by Association: Length Generalization Transfer in Transformers Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.877330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.877330Z digest=sha256:34291f2b78fd184c8fd9769b3542f10644fde7623bac79f66594344176fa2c9a

Observation cf976f1f-9c79-4d43-a47c-1f432f944a26 · outbound

This paper cites Exploring compositional generalization of large language models.

Extrapolation by Association: Length Generalization Transfer in Transformers Exploring compositional generalization of large language models

Reference 41

Resolution
verified exact
doi, observed 2026-08-07T04:59:26.218317Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:23.899963Z digest=sha256:e8197cbf3223b63c06687a38903212c4c9f85695cdef9be1a498a96ba489cc41

Observation b53566eb-d69f-4318-bb93-bc6ecbbd7aa4 · outbound

This paper cites From local structures to size generalization in graph neural networks.

Extrapolation by Association: Length Generalization Transfer in Transformers From local structures to size generalization in graph neural networks

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:59:26.011943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-07T04:59:23.938981Z digest=sha256:effcb5549ac3565e2473da6be296b0cff1de1d4f96b290e7e834bb842d793982

Observation aef55765-ae28-4010-90d0-c3d1e47d1f2b · outbound

This paper cites Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models.

Extrapolation by Association: Length Generalization Transfer in Transformers Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:23.971111Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:23.971111Z digest=sha256:cc051ff77b577216ae440bde8296f2de5ca772694883b7b82166ff3d7d073a8e

Observation 29f2d413-7634-4ce7-b67a-fc133faa463e · outbound

This paper cites On the Out-Of-Distribution Generalization of Multimodal Large Language Models.

Extrapolation by Association: Length Generalization Transfer in Transformers On the Out-Of-Distribution Generalization of Multimodal Large Language Models

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.045107Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.045107Z digest=sha256:0fe7a195cf63e80462dc03ae3110fbaec72ab8b476a8c8f13b6e2ddee6edabec

Observation 43353b2d-a060-49c6-b053-a5b93d897d63 · outbound

This paper cites Can Models Learn Skill Composition from Examples?.

Extrapolation by Association: Length Generalization Transfer in Transformers Can Models Learn Skill Composition from Examples?

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.138329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.138329Z digest=sha256:99673e29f0510c89d0239af076c9597a75eb290267084e6f97c685f556b7fbc3

Observation 1b4e5d1f-9277-4d54-a717-643538901f11 · outbound

This paper cites What Algorithms can Transformers Learn? A Study in Length Generalization.

Extrapolation by Association: Length Generalization Transfer in Transformers What Algorithms can Transformers Learn? A Study in Length Generalization

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.336490Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.336490Z digest=sha256:8915346c59bdf3deb416c8df1855709f0431acd61575957d80e848eea3f6bd60

Observation fe812d76-337a-468b-bb5d-f301e3e82b77 · outbound

This paper cites Transformers Can Achieve Length Generalization But Not Robustly.

Extrapolation by Association: Length Generalization Transfer in Transformers Transformers Can Achieve Length Generalization But Not Robustly

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.440272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.440272Z digest=sha256:5683bd59e2e60d753a771754a46ad9638baf22af5562e727fd9a97dcd76d17f7

Observation 5fe4a088-6910-42c2-9ab2-8c968b0b28fd · outbound

This paper cites @esa (Ref.

Extrapolation by Association: Length Generalization Transfer in Transformers @esa (Ref

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.587952Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.587952Z digest=sha256:679b8f6fe0c5cb1b1a84c54ba650315de4003aa239fad49e744b0ec1ea935c42

Observation cf950190-ac2b-4194-9e00-327e15c5523e · outbound

This paper cites an unresolved cited work.

Extrapolation by Association: Length Generalization Transfer in Transformers Unresolved cited work

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.712076Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.712076Z digest=sha256:1c6571545386f5a6adae3a7e26dd7162e0d8891eb161d8eb7ecdc45c3567edff

Observation 245a4987-fe07-4383-864a-66d84e865991 · outbound

This paper cites Gw4YHj hk 9(kIwxS4g6ŘT kI,pk QXf4!׵G 1F <Fi<5 Si,pk -)#cA M;5zt`vj.

Extrapolation by Association: Length Generalization Transfer in Transformers Gw4YHj hk 9(kIwxS4g6ŘT kI,pk QXf4!׵G 1F <Fi<5 Si,pk -)#cA M;5zt`vj

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T04:59:24.796012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:59:24.796012Z digest=sha256:34231284885eb09fe837bd5ce5b333587fc6dbcabbaa54d29967d24a1e6e6c93

Pith citing papers

Observation 9188c2a1-aea5-40cf-955f-a0c64e354a7f · inbound

Resizing the giants: How modelling adiabatic interiors impacts predicted planetary radii cites this paper.

Resizing the giants: How modelling adiabatic interiors impacts predicted planetary radii Extrapolation by Association: Length Generalization Transfer in Transformers

Reference 3

Resolution
unresolved
no resolver link, observed 2026-07-13T18:39:30.627856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-13T18:39:30.627856Z digest=sha256:38d07d265f55bb47e51745d23ae87c82eec945a37d4ed018a2d3bfacac20b01f

Observation a1082e5a-8ddb-47a3-b8c7-d139f47efade · inbound

Generalization in LLM Problem Solving: The Case of the Shortest Path cites this paper.

Generalization in LLM Problem Solving: The Case of the Shortest Path Extrapolation by Association: Length Generalization Transfer in Transformers

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-05-10T10:39:38.094495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-10T10:37:45.355872Z digest=sha256:e3bb67af59903004d1cd1a28a5ad5a535783934bf2bf072e083c5558a792a735

Observation db4eb563-96aa-4d12-9672-69cfe27f1e89 · inbound

Stabilizing Extrapolation in Looped Transformers via Learned Stochastic Stopping cites this paper.

Stabilizing Extrapolation in Looped Transformers via Learned Stochastic Stopping Extrapolation by Association: Length Generalization Transfer in Transformers

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-06-30T07:34:21.665711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-06-30T07:29:23.786653Z digest=sha256:451d7b050c0f9d12e4422d3675cca3d2bac0300c917ef93137930a0c97929a7d

Observation dbb801d3-d95d-4221-8c25-ca90905e7e47 · inbound

Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks cites this paper.

Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks Extrapolation by Association: Length Generalization Transfer in Transformers

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-01T17:31:45.986659Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T17:31:45.986659Z digest=sha256:69c00fa71ce14bd7f6c5e0d31af345c349bad0bb3eee606ce0f9c49014960056