Pith. sign in

Paper Citation Record · LEDGER

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth

As of 8 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2608.01075.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.01075 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T00:37:19.896786Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

  • verified exact2
  • verified fuzzy1
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 484f5564-ccef-4a3b-bc06-6e7381e76b29 · outbound

This paper cites The Tied control implements this constraint and empirically matches the parent at the observed milestone up to ordinary training nondeterminism.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth The Tied control implements this constraint and empirically matches the parent at the observed milestone up to ordinary training nondeterminism

Reference 2

Resolution
malformed identifier
raw_fallback, observed 2026-08-06T00:37:20.566586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T00:37:19.896786Z digest=sha256:0ec1754a541a60ff61378084682f50ad4ef7015682c9a10c88d5c637af1c0d25

Observation 6fd608c6-cec0-482d-bcd7-ed880b367fb0 · outbound

This paper cites GLU Variants Improve Transformer.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth GLU Variants Improve Transformer

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:18.975089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:18.975089Z digest=sha256:40c0a8316a5cc69e686d57ceada708eee69ec71e5b7c625e2feca1aa0ee9f304

Observation e43a9203-e47e-47ff-a335-5fe718e8e4b5 · outbound

This paper cites Depth-Attention: Cross-Layer Value Mixing for Language Models.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Depth-Attention: Cross-Layer Value Mixing for Language Models

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-08-06T00:37:20.139453Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T00:37:19.497342Z digest=sha256:2094aa10f58d18709b6fd140da91175f04b2b265dd734277973fa1a0df3739f3

Observation 1bc3ab78-2a7c-4c0d-8524-7b9e5213dc6b · outbound

This paper cites Value Residual Learning.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Value Residual Learning

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:19.608145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:19.608145Z digest=sha256:4f24b655b720cf0900b5318832f3e618eb8c7de4dfeb3c1f55d032c57e5a2dfb

Observation d342ccf9-6985-4b60-803a-d845208d8930 · outbound

This paper cites Hyper-Connections.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Hyper-Connections

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:19.689219Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:19.689219Z digest=sha256:c72501fcfb16ec2827022432802dabff04b452ef249c38a618e94bbd93658d6b

Observation 670fb4fe-6264-4854-abdb-d6062a12456b · outbound

This paper cites Relative PPL reduction is (PPLBlock −PPL RD)/PPLBlock.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Relative PPL reduction is (PPLBlock −PPL RD)/PPLBlock

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T00:37:20.785710Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T00:37:19.791643Z digest=sha256:d5e11b388a07785270ca40bb95b6e8496a599e6029d35d5769eeca4f98c42993

Observation c442a64a-4c59-47db-bbc5-704ac36deea6 · outbound

This paper cites Attention Residuals.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Attention Residuals

Reference 2016

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:18.740108Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:18.740108Z digest=sha256:96fa341dfe49eca9ba79ab3a08ae58e7d43b62a1ff7bedd0d68ed510dba5db49

Observation 1edb3645-7ef2-4d43-938c-ea74b5a4f564 · outbound

This paper cites MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:19.285243Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:19.285243Z digest=sha256:83567fd6b64ababec4bcddc36b5c49d292c8128d5145dc6b7b4b20c7247a351e

Observation 4b52cf74-6b4b-4efd-b5c8-8ae85fb78c3a · outbound

This paper cites Delta Attention Residuals.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Delta Attention Residuals

Reference 2019

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:18.782193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:18.782193Z digest=sha256:49ab320bbf046bd4937be0a75ddcfcc36c6767c9713f1ac2a4614e28e2e65e1e

Observation 06f2201b-62b8-4d3c-a487-86870c654d94 · outbound

This paper cites RoFormer: Enhanced Transformer with Rotary Position Embedding.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth RoFormer: Enhanced Transformer with Rotary Position Embedding

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:19.074615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:19.074615Z digest=sha256:211c15492def7080aa34869e52d67aafc455278e295465458c9a8310ca298e08

Observation 2b8bc917-b0e9-4f93-b2c8-d4b3c8fbf4c4 · outbound

This paper cites Low-Rank Attention Residuals.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth Low-Rank Attention Residuals

Reference 2021

Resolution
verified exact
local_arxiv, observed 2026-08-06T00:37:20.311574Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T00:37:19.177184Z digest=sha256:13e76d4f4835e6d3428a5d80039c56e4886263b01126a51efec4fd0ab08cd537

Observation fe0cd2eb-3935-4797-8085-991124f3e6f8 · outbound

This paper cites The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:18.896157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:18.896157Z digest=sha256:3eec353b54ea5b926e36076427a85ed6689ffc30e5ab74d534e65a6ba5d7699b

Observation a0397c07-2db0-4906-9569-bada141ad82d · outbound

This paper cites mHC: Manifold-Constrained Hyper-Connections.

Role-Decoupled Attention Residuals: Separating Matching and Content Retrieval Across Depth mHC: Manifold-Constrained Hyper-Connections

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T00:37:19.396716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T00:37:19.396716Z digest=sha256:2cc9bac7b4db88facc821e58fbad27a30f272236bc79bbf004a42a1813c322de

Pith citing papers

No inbound Pith citation observations are available.