Pith. sign in

Paper Citation Record · LEDGER

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization

As of 10 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2506.06398.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.06398 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:19:32.086306Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

  • verified exact4
  • verified fuzzy1
  • unresolved16
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7ad8bfc7-20ff-40bd-8769-c3b653705cd5 · outbound

This paper cites Unconstrained representation of orthogonal matrices with application to common principle components.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Unconstrained representation of orthogonal matrices with application to common principle components

Reference 1

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:19:32.953160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.156526Z digest=sha256:6591d7fab723de1c78571e0dd374a39fe4e0883ed5ede482bfd0aba2c227a1f0

Observation b3798f3b-b609-4e96-810c-33ba724c48a3 · outbound

This paper cites and Mendelson, S.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization and Mendelson, S

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:19:33.587061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.246368Z digest=sha256:97f78e1a9e43bb196467310bc8a40ff7fe393fd99c8a0ac60a07c789c4280cf4

Observation dc171fc4-10e0-47ee-b9bd-4a73c2207481 · outbound

This paper cites A Universal Law of Robustness via Isoperimetry.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization A Universal Law of Robustness via Isoperimetry

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:30.332600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:30.332600Z digest=sha256:9281121d5cd3e32dd841815676aefba9201f2ec169e0bd3b1776d24a9af053d1

Observation 4c728534-3b2a-451e-b66d-0d34509433ac · outbound

This paper cites AutoFormer: Searching Transformers for Visual Recognition.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization AutoFormer: Searching Transformers for Visual Recognition

Reference 4

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:19:32.774839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.410597Z digest=sha256:374aefc37d2339696be66a2a157e64d62361465782600354bd24c3406174b368

Observation ac2c5f3c-aa08-4d11-8ea9-b037cd5082a6 · outbound

This paper cites Naturalistic audio-visual volumetric sequences dataset of sounding actions for six degree-of-freedom interaction.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Naturalistic audio-visual volumetric sequences dataset of sounding actions for six degree-of-freedom interaction

Reference 5

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:19:32.595687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.528890Z digest=sha256:21bdac45bee3f5fa956bf5a26d29ad975a32cb6e0350a5a4f42de93effbcefe1

Observation 54ce9111-c511-4091-88f4-902a3ec13d5d · outbound

This paper cites an unresolved cited work.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:19:33.434175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.792586Z digest=sha256:c9b96b680f8f99833fd08a81fa9afef625daafe56b445890dad1a4eb8d809ca0

Observation 042b9330-00aa-4be9-8d94-0ad9898dab60 · outbound

This paper cites an unresolved cited work.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:19:33.304007Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.889653Z digest=sha256:5abf8019cc39919ad4220f3a36aec5a501d6cb2246375bde011f8fdc5c895a52

Observation 10216bbe-cc0d-41a7-b5e1-4748187d990b · outbound

This paper cites an unresolved cited work.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:19:33.127874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.920214Z digest=sha256:567821d7f4f76916341800f4a55ebbc0f478f050f70719e8e4ba1ee8ca7c0ae9

Observation d2675f38-6d3c-48e6-81bc-c3b8073fb057 · outbound

This paper cites ConvBERT: Improving BERT with Span-based Dynamic Convolution.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization ConvBERT: Improving BERT with Span-based Dynamic Convolution

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:19:32.445067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-07T10:19:30.997976Z digest=sha256:0cccb56a16a18758f15a0880e597aaa6741ed57a6ed0e4f9fa5cccb1e79215eb

Observation b04b5812-7f82-4b0c-a0eb-1b8c113e494f · outbound

This paper cites Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networks.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networks

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.112025Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.112025Z digest=sha256:b5d9b0cb6d1c665043dbab63257f59b100807051ddc08ea6517b9b099e526524

Observation 509fa2d2-c090-4cfa-ae32-e654d9307da2 · outbound

This paper cites Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.163992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.163992Z digest=sha256:880d004e612180903b2a91e9613a51afffd70be4993a4d976604477cb4ab22ec

Observation 8c9bd168-5301-482c-8fbd-2d8016df0ff0 · outbound

This paper cites Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.246860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.246860Z digest=sha256:233a4c9dfa53cf5dd35cae4f7f3bacc4a5ecaa43704c7fdbfdaedc9fd16d3303

Observation 006bdfb4-ff31-4941-8949-ab402362cee8 · outbound

This paper cites Self-Attention with Relative Position Representations.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Self-Attention with Relative Position Representations

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.342489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.342489Z digest=sha256:5f52baa00c077b007180802c1bf4b5c71873a743685d4b8a154e0346936d79de

Observation 732b4608-62bf-481d-b2c4-5589b82ba0c2 · outbound

This paper cites RoFormer: Enhanced Transformer with Rotary Position Embedding.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization RoFormer: Enhanced Transformer with Rotary Position Embedding

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.465132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.465132Z digest=sha256:286276e954ffe603993f69dd8c8cd2c89951f4d74442c2f6db2fce7b297cb046

Observation 27c16d0e-8299-4644-922a-4a85167292ac · outbound

This paper cites Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.558026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.558026Z digest=sha256:649e6c46b4b71a9967c3250000e4620b62a3ff5f06e255b6c0f69712ec4acc28

Observation 10f83ea2-3167-47af-be9d-9e55322ee048 · outbound

This paper cites Efficient Transformers: A Survey.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Efficient Transformers: A Survey

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.651037Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.651037Z digest=sha256:a2e4fccee0bb8847c1fcf9cd80ea64142510801376bb9a941bcaf28a04430418

Observation 1a322ae6-6cac-4d3b-ae9c-6b92d9341414 · outbound

This paper cites Attention Is All You Need.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Attention Is All You Need

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.725031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.725031Z digest=sha256:322a8ffa417d8c614d371bcfa0b91c7017c16475057ff7cfcfa3962544035d24

Observation 4a130c54-a35d-459e-a7ab-7aa0a4cda795 · outbound

This paper cites On Layer Normalization in the Transformer Architecture.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization On Layer Normalization in the Transformer Architecture

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.818374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.818374Z digest=sha256:aca37e36ce7e7f3a59c4c35b0cec5f7c72c2ab238e6da562d1e8b62937bfef98

Observation d8d327d9-dd89-41f0-a37d-80218f5ed129 · outbound

This paper cites Efficient Attention: Attention with Linear Complexities.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Efficient Attention: Attention with Linear Complexities

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.887945Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.887945Z digest=sha256:5274d0c3a82e29a2e010463110095c6d079c257b8b1bbb357c84e0586a278422

Observation 84a07a37-1edc-468f-b252-8735743043ca · outbound

This paper cites Are Transformers universal approximators of sequence-to-sequence functions?.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Are Transformers universal approximators of sequence-to-sequence functions?

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:31.995796Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:31.995796Z digest=sha256:e566743b3f0ac5cb67a4567dad52deef1c052e89b4128cf17c153e06178806ef

Observation c2e63405-5085-4b8d-b3c8-131abe7a4d76 · outbound

This paper cites Transformers without Tears: Improving the Normalization of Self-Attention.

Theoretical Analysis of Positional Encodings in Transformer Models: Impact on Expressiveness and Generalization Transformers without Tears: Improving the Normalization of Self-Attention

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T10:19:32.086306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T10:19:32.086306Z digest=sha256:ceb180ca5c671b6dd0f35c5fc1575c774c4284d1cf568864869e23fee72ace3d

Pith citing papers

No inbound Pith citation observations are available.