Pith. sign in

Paper Citation Record · LEDGER

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization

As of 10 August 2026, this Paper Citation Record lists 50 of 50 outbound references and 0 inbound Pith citation observations for arXiv:2607.07678.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.07678 v1

Coverage vector

measured 50 of 50 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-09T02:52:28.852922Z

measured 50 of 50 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

50 of 50 outbound references displayed

  • verified exact7
  • verified fuzzy39
  • unresolved2
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1694792b-e549-4aba-b9d3-5d02733aaaad · outbound

This paper cites Alabdulmohsin, Vinh Quoc Tran, and Mostafa Dehghani.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Alabdulmohsin, Vinh Quoc Tran, and Mostafa Dehghani

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.892857Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b8fa50a5da54e56170d3f45a15fea882e5a9a4979b6594c89dff9284e283d0c4

Observation 0ce85a18-55d6-4b94-b8ff-326507bd9a14 · outbound

This paper cites Neural machine translation by jointly learning to align and translate.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Neural machine translation by jointly learning to align and translate

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.832797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:778a232e50aee22fdba2ebcbd1652a35a599ff65c3395144414bf7484c912508

Observation 7063f56a-3c4d-4bd3-9053-34bb55f5ba5e · outbound

This paper cites Round and round we go! what makes rotary positional encodings useful? InICLR, 2025.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Round and round we go! what makes rotary positional encodings useful? InICLR, 2025

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.856586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:32a627e5ecdde5af9f818eb63f231eadf1510de0150d41c0a29c97b415356949

Observation da561eac-8b08-41aa-8b20-b3d4756f7c61 · outbound

This paper cites Relational inductive biases, deep learning, and graph networks.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Relational inductive biases, deep learning, and graph networks

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-07-09T02:55:53.505422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e789b745c71c3126595aab831cb956a34aad135f78e489906f1c53e63051c0c6

Observation 04ff8185-920b-4cf7-9be6-17d86a28ebbe · outbound

This paper cites by Parts.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization by Parts

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.846895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e1fa8a46d71d55bc1709bf3d82002610cd1ab9e4ef29320ccc8eaea0c2751528

Observation ece55931-732c-4909-96b3-f24412798e09 · outbound

This paper cites NTK-Aware Scaled RoPE Allows LLaMA Models to Have Extended (8k+) Context Size Without Any Fine-Tuning and Minimal Perplexity Degradation.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization NTK-Aware Scaled RoPE Allows LLaMA Models to Have Extended (8k+) Context Size Without Any Fine-Tuning and Minimal Perplexity Degradation

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.845011Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:c01146a97048d146039e697d9f96857b9d906c8cf329add54e35ea2008c2c253

Observation 29d6936a-fe67-4fc3-a44e-5fab0b4cf375 · outbound

This paper cites Extending Context Window of Large Language Models via Positional Interpolation.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Extending Context Window of Large Language Models via Positional Interpolation

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.504805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f0ad3cd83d5c40c46e0c8fc9908cbe360eef0210d69d7428ec8fbb6d238f421b

Observation 841f58c6-d6fb-49c7-96e8-417e11025cc0 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Training Verifiers to Solve Math Word Problems

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.520293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:eeff2426f2da0b91be217c2a6ac9ef595d97a810ef8259a4d82271d547d84bca

Observation 90fbd041-b348-4dd2-8ec7-42a983133588 · outbound

This paper cites Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.507969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:2d46dfba3473bcbd43b34b2c8d5e13c7a25af36ae3fb62b4e753549ccaa4a1b2

Observation ba26b5e8-bba0-4e5a-8247-860db6e21584 · outbound

This paper cites Dynamically Scaled RoPE Further Increases Performance of Long Context LLaMA with Zero Fine-Tuning.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Dynamically Scaled RoPE Further Increases Performance of Long Context LLaMA with Zero Fine-Tuning

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.850561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:253eb1b3fd568c4cb07462a4f64e780c509cdd9c67a64564e7b30dda3db2a5fe

Observation 8dd77c53-abfc-460f-8cfb-1a8a671423b9 · outbound

This paper cites What is Wrong with Perplexity for Long-context Language Modeling?.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization What is Wrong with Perplexity for Long-context Language Modeling?

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.525674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e8e578bc8c059758f164b5855bb5760a1f26d16a31a7bf03df1db8501bf037a7

Observation 7ac5d788-9e4a-46dc-9fc9-228b099904e7 · outbound

This paper cites Rethinking invariance in in-context learning.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Rethinking invariance in in-context learning

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.887524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:a7b9a273c6918a40a6c00c4115789cd4a7774622648dea27ae54eaf41ae0226b

Observation 32be4c5b-cf09-41e6-941a-34772186d023 · outbound

This paper cites When attention sink emerges in language models: An empirical view.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization When attention sink emerges in language models: An empirical view

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.885655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b2758165044050d79e7482e6a8a7fe1448483c213b10f4f88d64a9bf227670da

Observation 5ec052e8-682c-46ed-a97e-02913556d7f2 · outbound

This paper cites Serial position effects of large language models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Serial position effects of large language models

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.840929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:5a2c9a39a73dfc2736ab0a858c03982ba3110a845eae127d559ee21e315dce30

Observation 728d0568-2d93-421b-a4de-01ed6c854ef5 · outbound

This paper cites Large language models are zero-shot rankers for recommender systems.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Large language models are zero-shot rankers for recommender systems

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.834878Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:4fed54a54f43b16b279f8d282a52cdfeeac6e25b77b56fbf820ad672dc02b4df

Observation 25934c14-3821-4bbf-bade-07ff0e251fd3 · outbound

This paper cites Fourier position embedding: Enhancing attention’s periodic extension for length generalization.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Fourier position embedding: Enhancing attention’s periodic extension for length generalization

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.839036Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e8f5319ef052af9dbef589dc8e02f9b211b63bf92917e9eb218d36108cfeb21e

Observation ace7169e-fb47-49d3-a124-20a099e71fc9 · outbound

This paper cites Massive values in self-attention modules are the key to contextual knowledge understanding.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Massive values in self-attention modules are the key to contextual knowledge understanding

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.852489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:a51856c3177d81150708f58b6c6a00e135e5e25c913caf9758a2d803736a225d

Observation 638eb450-fd9a-4808-a077-c2924b0cd87b · outbound

This paper cites nanochat: The best chatgpt that $100 can buy, 2025.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization nanochat: The best chatgpt that $100 can buy, 2025

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.854554Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:ecbdaf6aff41da85ebd7aca44c641952cac59a69fe7f5b63536ca2773fa9db17

Observation 77ad794b-56ea-4d7d-9f77-dcfce9301e61 · outbound

This paper cites The impact of positional encoding on length generalization in transformers.Advances in Neural Information Processing Systems, 36:24892–24928.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization The impact of positional encoding on length generalization in transformers.Advances in Neural Information Processing Systems, 36:24892–24928

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.883743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:471e1ac32f3217a5901372ddecc449059934fefcd5b20b7f83b06bf677b48d25

Observation e227fe76-e5bf-46a5-acf9-8619a88bdcce · outbound

This paper cites an unresolved cited work.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-07-09T02:55:53.835870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:168902556b692edd4af39ec9d4daf2f3db17c84093d1430607b18bab6efdab84

Observation 23e0c57e-3b2a-41a8-b1fb-ace95c02c96b · outbound

This paper cites Mutual information functions of natural language texts.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Mutual information functions of natural language texts

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.881592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:41c481b0e7028467a367da3ba5314467acbee4e3ac81d5a885eda62a60cbe572

Observation 857c26ca-5e7d-4140-8c44-9d094a04b7d2 · outbound

This paper cites Lost in the middle: How language models use long contexts.Transactions of the Association for Computational Linguistics, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Lost in the middle: How language models use long contexts.Transactions of the Association for Computational Linguistics, 2024

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.842923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:fd78c67927a69c7245c787ad76735f251285f79a2e3347e49a95b5d4a33adaf3

Observation 39746906-d9dd-4804-b07d-49803647a185 · outbound

This paper cites Decoupled weight decay regularization.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Decoupled weight decay regularization

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.860391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:73d5a4e33a2bb0844f1d1c7c0d978802e0fdeeb367fbe49d80c2b2cb81fe9d48

Observation db667a91-1eed-4dd4-8553-6631b722052a · outbound

This paper cites Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.900093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:6406c3f080b45790b0a0c5a3d46a94beddefe73119880e6125c904691249e2c7

Observation 77336fae-c8fc-4f5f-b32e-6f2089c1964c · outbound

This paper cites Base of rope bounds context length, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Base of rope bounds context length, 2024

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.879676Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:44d0299e86e7c5a153c5dc314e60a69ae418800ec04d912c7f308806a7ced201

Observation 3bfab21b-c9c0-4a61-a6f0-62e1913da9ab · outbound

This paper cites Note on the bias of information estimates.Information theory in psychology: Problems and methods, 1955.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Note on the bias of information estimates.Information theory in psychology: Problems and methods, 1955

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.870307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:1a71f5e911a098cb1394ee880684fe6069e7b9a7b677cc431aee83a53584406d

Observation 17271e25-aa14-4e9f-8ed3-e09180f598ee · outbound

This paper cites Rethinking the role of demonstrations: What makes in-context learning work? InEMNLP, 2022.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Rethinking the role of demonstrations: What makes in-context learning work? InEMNLP, 2022

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.864263Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:ec2fb1ab852bb5c6abf2a4aa2d2cf44a06e552c5c06caef944f03395ca235e76

Observation c401083d-0136-4980-9599-db737b126952 · outbound

This paper cites Mitchell.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Mitchell

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.889207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:9224c873bf4c848539612f4454ec35882197ed62723c6da59f2b5780de33dcc5

Observation 8e626207-c5b8-4f20-ab68-ecde5be4822a · outbound

This paper cites Frequency bands in roPE: Base frequency and context length shape the interpolation–extrapolation trade-off.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Frequency bands in roPE: Base frequency and context length shape the interpolation–extrapolation trade-off

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.866397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:8b542aaade80b96937f9b83a5c69a83223013dd4a0c4748445c80a9338ddb8f8

Observation 780a16b0-ecb2-4ff2-aa74-996b8603f274 · outbound

This paper cites In-context Learning and Induction Heads.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization In-context Learning and Induction Heads

Reference 30

Resolution
metadata mismatch
local_arxiv, observed 2026-07-09T02:55:53.510704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:75813e59407fc6c5a6cc35e5e0c92c70bc9475db6463dfff95cecdb5f62615bc

Observation 6290b305-bd55-4ba2-9b21-8af38392101e · outbound

This paper cites Yarn: Efficient context window extension of large language models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Yarn: Efficient context window extension of large language models

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.868302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:58ce9d3fa34115654dc294adb425c30f2ddcb4cb9b1b60a00381cd5f3a97aec7

Observation e0125542-9c0d-40c7-bde6-5ddda5db775d · outbound

This paper cites The mechanistic basis of data dependence and abrupt learning in an in-context classification task.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization The mechanistic basis of data dependence and abrupt learning in an in-context classification task

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.830788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:3d70d3e9e9324f3cf0adcd5760aecf9315a076a42e87c990b54a241553b5639f

Observation 91a0ecef-7c38-4d91-972a-6051c2c9b561 · outbound

This paper cites Roformer: Enhanced transformer with rotary position embedding.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Roformer: Enhanced transformer with rotary position embedding

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.877800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:1aca8f500af216b3d5f8a0e10a18911137b2346e95689b90d1f297b725344a2b

Observation e200f095-8e72-49de-bc06-c7ddd1d4131a · outbound

This paper cites Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.874127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:a63af63039151e89d267020fa9ed0ff4d408c164062f34d8084ff7f58aa581fc

Observation 0736f869-6dc4-4a67-91a8-b90208155d68 · outbound

This paper cites Hashimoto.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Hashimoto

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.828734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:0813da72920cb4c474455ad946a27080b3140c4f67e65ca8591f19091f82a522

Observation 9c32bdf4-720b-4310-8de1-84a059ce7b72 · outbound

This paper cites Qwen2.5: A party of foundation models, September 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Qwen2.5: A party of foundation models, September 2024

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.872324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:18fc8653b4f8f4e570a9fa150709c5bd6759676671a6ae44ba98dd5b0025aa92

Observation 21bfe6b3-c7f1-45a9-a4c9-7b154b3b257d · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization LLaMA: Open and Efficient Foundation Language Models

Reference 37

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.517990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b39e515063343c4f18cd64821aa4477e407686f36468498dd96058d7861bfb43

Observation bfadd9d9-c3e1-4886-97dc-fa7d42b95913 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 38

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.523024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:763bce408acc69a1522c9f52b943c7e7d10ab22a248a5ebd7ccf0d906c3dab21

Observation 2574888a-590e-444c-b904-b02ce971fbeb · outbound

This paper cites Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.875850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:247a346c0d01982ba3cabf548d02d8c3797b0a75e40d6058aad4befcc75c6618

Observation b5514cb7-9d29-4b4a-b2de-397ce211dfba · outbound

This paper cites Kakade, Hao Peng, and Heng Ji.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Kakade, Hao Peng, and Heng Ji

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.891012Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:9a0702e26f9c2e4dea1a5dd43554683a58cb7fa6318836fe3512f1a16a81e02b

Observation a300dc53-d92f-4f2e-a137-b76537a25550 · outbound

This paper cites an unresolved cited work.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-07-09T02:55:53.858476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f17e5f0f3a944bfa2258de44b146d29647461de0b0cab5fe1a91ad90e0d55259

Observation 53e2db8a-040b-402a-b8e8-499e3f8ff9b5 · outbound

This paper cites On the role of attention masks and layernorm in transformers.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization On the role of attention masks and layernorm in transformers

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.862252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f8158377adb36bf8c01fd38ce2887e206cf9630dbaf23e9fc327d0417c73a809

Observation 1a3f7d3d-68b2-4bcd-a516-6d78c2c04165 · outbound

This paper cites On the emergence of position bias in transformers.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization On the emergence of position bias in transformers

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.894668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:78510d5a335e3a235eff45924ec7ec7e22e8579f9a124ab37d8012c33bc3a93a

Observation 81277e6e-bdb1-44e9-a6a3-cd7a0993c5e3 · outbound

This paper cites Efficient streaming language models with attention sinks.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Efficient streaming language models with attention sinks

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.839852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:611829941f51d8828a806fad0e34114df3913fd99ef2e4658f2b28f8b3753bb2

Observation e22f475f-a47b-4caa-b7fa-645bad8cc22d · outbound

This paper cites Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process

Reference 45

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.514975Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:3bfd4d2bd66c1103db45039b0148cb2907243cec01b2d6bb50d2009af551c281

Observation 38e1eb26-8f65-4542-a5da-16adccc536ac · outbound

This paper cites Reddi, and Sanjiv Kumar.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Reddi, and Sanjiv Kumar

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.848655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:d0192195860f632845ce9cf12f9d8b14f28230598a1611270b0cf688c5bd4520

Observation 3ca05476-8c3f-469d-8cf2-615542bc6cc8 · outbound

This paper cites Found in the middle: How language models use long contexts better via plug-and-play positional encoding, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Found in the middle: How language models use long contexts better via plug-and-play positional encoding, 2024

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.779142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:20f803fa5ee61fdbd00bf368b9f7e9473f4c325e6beb187ef9968ed07b6587a7

Observation 50d61d94-f5bd-4018-9844-a1beaa0b7eea · outbound

This paper cites Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.897922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:479c3252fe6b4c0a3bf9217df1d7de9fb6268b316a6c0011e11e2aedbfc7ecef

Observation bc3321f1-1aeb-477d-885b-acf01a44c0e6 · outbound

This paper cites Xing, Haotong Zhang, Joseph E.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Xing, Haotong Zhang, Joseph E

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.836812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:aa43cb74786f2a95db95a64fd1568b324ab02c14df2f64265c75bc2b3c5edbaa

Observation c119a7cc-620f-4da8-a434-21d4cd5b6195 · outbound

This paper cites [43] show the multi-layer effects of masks and positional encodings [43].

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization [43] show the multi-layer effects of masks and positional encodings [43]

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.820066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:cd1b6480369271017e916dc56a73bacd48fc88b5f6529ae670605ce1e1067884

Pith citing papers

No inbound Pith citation observations are available.