Pith. sign in

Paper Citation Record · LEDGER

DeepCrossAttention: Supercharging Transformer Residual Connections

As of 10 August 2026, this Paper Citation Record lists 17 of 17 outbound references and 2 inbound Pith citation observations for arXiv:2502.06785.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.06785 v2

Coverage vector

measured 17 of 17 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T14:27:23.951214Z

measured 19 of 19 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-13T20:23:40.027519Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-13T20:28:14.158183Z

Reference resolution

17 of 17 outbound references displayed

  • verified exact0
  • verified fuzzy4
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 593cb35f-fa29-4db7-b6dd-e7f34b11b94b · outbound

This paper cites Better plain ViT baselines for ImageNet-1k.

DeepCrossAttention: Supercharging Transformer Residual Connections Better plain ViT baselines for ImageNet-1k

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.888943Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.888943Z digest=sha256:3b5a6fac34ec10f6b5684f4921d563c719b5e0d3b5361cbe5c6ce169f993a544

Observation 783e7de9-cd6a-49e3-98a0-b1ab4c55b4e8 · outbound

This paper cites One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling.

DeepCrossAttention: Supercharging Transformer Residual Connections One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.894211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.894211Z digest=sha256:f26779e4ecadd98bf73020ea127c38871d97b781c47be828f44b16ac034ddda0

Observation 9759928c-8ce4-4ff5-9f24-604fff12399c · outbound

This paper cites W., Sutton, C., Gehrmann, S., et al.

DeepCrossAttention: Supercharging Transformer Residual Connections W., Sutton, C., Gehrmann, S., et al

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.898824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.898824Z digest=sha256:f838e683fe0487bc5c62d44599ba3e4528d76f2d3745451e56b166fb0825c19a

Observation 37633e80-5360-479c-be5f-de2840968c61 · outbound

This paper cites An image is worth 16x16 words: Transformers for image recognition at scale.

DeepCrossAttention: Supercharging Transformer Residual Connections An image is worth 16x16 words: Transformers for image recognition at scale

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T14:27:24.164534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.902531Z digest=sha256:74b650ebf9c708c214df2640765e91996bfa827382de2dea6834e3a3a8008044

Observation 1cbb7fb1-6273-465e-a884-4f5be2fe33a0 · outbound

This paper cites Ast: Audio spectrogram transformer.

DeepCrossAttention: Supercharging Transformer Residual Connections Ast: Audio spectrogram transformer

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T14:27:24.151255Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.906491Z digest=sha256:fd5701283f659b664a2eb75f32d12ca7afaa09bf347066ef8fdec793e88d7c14

Observation 3a9a08e7-9aee-49a8-bead-934a5a76d27d · outbound

This paper cites Deep residual learning for image recognition.

DeepCrossAttention: Supercharging Transformer Residual Connections Deep residual learning for image recognition

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.909955Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.909955Z digest=sha256:4818ff9957fd3bc908fda741ba583ffc1283eba2c1a717c453fb99469e9551c6

Observation f674a701-29e5-4768-8592-8184de9b72cc · outbound

This paper cites an unresolved cited work.

DeepCrossAttention: Supercharging Transformer Residual Connections Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.914050Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.914050Z digest=sha256:8c0105587850807241687d1907c8a2725f9b2052856a89964cdbcffb6d2a0b5d

Observation f0fda96f-23ec-4f9a-8a0a-eecb387a4b3e · outbound

This paper cites Implicit bias of large depth networks: a notion of rank for nonlinear functions.

DeepCrossAttention: Supercharging Transformer Residual Connections Implicit bias of large depth networks: a notion of rank for nonlinear functions

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T14:27:24.120768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.917685Z digest=sha256:c7621a1c822105a93faf2a0dd3e7ac85e2bffff28d1f22f23e6e4de127c7b913

Observation c2b0e381-456a-4b3f-b579-633d9a0bf29c · outbound

This paper cites L., Bahl, L.

DeepCrossAttention: Supercharging Transformer Residual Connections L., Bahl, L

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.921078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.921078Z digest=sha256:ee5d77b1b3e520ab56da7477c6c3aea7a194792576b818a9267093d3431c13aa

Observation 6da9f9e7-34f2-424f-aeaf-38bcd88db844 · outbound

This paper cites Decoupled Weight Decay Regularization.

DeepCrossAttention: Supercharging Transformer Residual Connections Decoupled Weight Decay Regularization

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.924588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.924588Z digest=sha256:98dab8c136d78b74eb48d6df7b81ce763fcbd4b5284cc4534ebde223add199d8

Observation ed8aae0d-e99a-484c-b214-ce3b05374553 · outbound

This paper cites Laurel: Learned augmented residual layer.

DeepCrossAttention: Supercharging Transformer Residual Connections Laurel: Learned augmented residual layer

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T14:27:24.098733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.928153Z digest=sha256:0b35619fa00b2791bb5bda3ac9feeee8be96c9d777635425000d450c7b51619c

Observation ebe7aba1-6590-450a-9732-4e7ba3053499 · outbound

This paper cites DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging.

DeepCrossAttention: Supercharging Transformer Residual Connections DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.931619Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.931619Z digest=sha256:8cb64947ad5f1bf8a12e632cac6b4306a13322e0762986cc41991943266c2406

Observation 6696358e-39fe-4ff6-aad2-4f647a3d8fbf · outbound

This paper cites an unresolved cited work.

DeepCrossAttention: Supercharging Transformer Residual Connections Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-08T14:27:24.085090Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.935532Z digest=sha256:5c4b128ef57dc28d845250b8efb88a19e5d4e29416c80a96565e3eda724d3500

Observation 03ec395e-b3e2-4ef9-8f85-9964b6245f06 · outbound

This paper cites an unresolved cited work.

DeepCrossAttention: Supercharging Transformer Residual Connections Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-08T14:27:24.071262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-08-08T14:27:23.939208Z digest=sha256:f5415fb9b99a13b726d8b0096338e115414ad273b2a1691796b62a4af4d374dd

Observation e02c36f7-e47b-484d-9647-a79daabc3a75 · outbound

This paper cites K., Greff, K., and Schmidhuber, J.

DeepCrossAttention: Supercharging Transformer Residual Connections K., Greff, K., and Schmidhuber, J

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.943092Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.943092Z digest=sha256:ac74cac75784f349f44f7aa34fbe951ab05c5b0d3d14acba1119d479e8fc3e4f

Observation 510495fb-65f0-4c26-b99f-ce311b911ef4 · outbound

This paper cites Attention is all you need.

DeepCrossAttention: Supercharging Transformer Residual Connections Attention is all you need

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.947141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.947141Z digest=sha256:b0795298e9ff837c74ccce1f67a452b62890414be7f921e14e8c71046625218e

Observation 79a16749-1245-4e4d-8edf-09d0619b7b54 · outbound

This paper cites Hyper-Connections.

DeepCrossAttention: Supercharging Transformer Residual Connections Hyper-Connections

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-08T14:27:23.951214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T14:27:23.951214Z digest=sha256:1000a17ef887b37777b5b4d12b6eca07f7654392a81aa5445009ff08a001e7e4

Pith citing papers

Observation a0d77b53-2146-4a9b-94fe-a3dc23cc81e7 · inbound

Gradient Boosting within a Single Attention Layer cites this paper.

Gradient Boosting within a Single Attention Layer DeepCrossAttention: Supercharging Transformer Residual Connections

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-13T20:28:14.159760Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-13T20:23:40.027519Z digest=sha256:9242642843dbeeae5ff72951dac4dac8ff91f137bb8c358d473c8550b5a64493

Observation 023d5f0b-4017-484d-be4d-bd9ffc1f901f · inbound

Hyperloop Transformers cites this paper.

Hyperloop Transformers DeepCrossAttention: Supercharging Transformer Residual Connections

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-11T14:16:04.542772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-09T23:09:35.640412Z digest=sha256:b77dee724c29c08076d7222d11922c8bef190fab35f2f61e010fc71fc4dfdd72