Pith. sign in

Paper Citation Record · LEDGER

TinyBERT: Distilling BERT for Natural Language Understanding

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 55 inbound Pith citation observations for arXiv:1909.10351.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1909.10351 v5

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 55 of 55 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 55 of 55 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T04:36:03.779140Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

137
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation a234e4eb-ab96-46dd-a4c9-9c43c87b8efc · inbound

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer cites this paper.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer TinyBERT: Distilling BERT for Natural Language Understanding

Reference 30

Resolution
verified exact
arxiv_id, observed 2026-05-12T05:37:55.651851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-12T05:37:55.083206Z digest=sha256:2d5b4e91961d09eadbdf5c262d5f4cd4b481b3fa6a32974c826dc699bf2ebade

Observation 2b8ff791-0b26-40cf-bf79-ab2754a1c3ff · inbound

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators cites this paper.

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators TinyBERT: Distilling BERT for Natural Language Understanding

Reference 3

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T10:26:47.617548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T10:26:47.593122Z digest=sha256:294ddcde86bd894245d2781066d1f683976b6b159b3c1c8c18708038ede970fd

Observation 36c3ec85-5ea5-4e26-9610-5c824a9590d3 · inbound

Language Models are Few-Shot Learners cites this paper.

Language Models are Few-Shot Learners TinyBERT: Distilling BERT for Natural Language Understanding

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-05-10T12:05:38.246816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-10T12:05:38.045330Z digest=sha256:435e453c4f6803dba1289095d30d94d60c2f860187174edb2b0a896a179307f8

Observation ea31a5b7-dd9b-4d75-b989-215bc7b9c7a7 · inbound

Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed cites this paper.

Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed TinyBERT: Distilling BERT for Natural Language Understanding

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-17T03:56:19.886797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-17T03:56:19.837017Z digest=sha256:58e4bf973e6ba3f4e28a33eef5dfbf979b0790737892939710d4d93cae5de4dd

Observation e602c5e8-4a61-423f-b148-b339287e4db1 · inbound

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing cites this paper.

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing TinyBERT: Distilling BERT for Natural Language Understanding

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-15T12:49:19.448400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-15T12:49:19.418548Z digest=sha256:f7b4a72ecd0633c93e35fea0fa6ad5823b1b484929800dec8bbd10ffafc38f05

Observation 0db5a29b-82ce-4f8e-9700-3b8397c6f31b · inbound

Fake News Detection After LLM Laundering: Measurement and Explanation cites this paper.

Fake News Detection After LLM Laundering: Measurement and Explanation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-10T04:36:03.779140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T04:36:03.779140Z digest=sha256:04eea872412bd32d7d1156d979e24d272d855a539e724132cbd2f1e04bbd0984

Observation 36675b5f-c8a7-4161-957f-7b814341f069 · inbound

BEEM: Boosting Performance of Early Exit DNNs using Multi-Exit Classifiers as Experts cites this paper.

BEEM: Boosting Performance of Early Exit DNNs using Multi-Exit Classifiers as Experts TinyBERT: Distilling BERT for Natural Language Understanding

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T17:57:25.760709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T17:57:25.760709Z digest=sha256:6940541c60c31f39407e9a6065b83ddc901a15d73a549da31f8c1d8fa7973bd5

Observation b2f779b1-5788-41e3-a593-46cebc98585b · inbound

On Teacher Hacking in Language Model Distillation cites this paper.

On Teacher Hacking in Language Model Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 2015

Resolution
unresolved
no resolver link, observed 2026-08-09T11:34:56.926817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:34:56.926817Z digest=sha256:6eec1c14de9ba5104905581af90d8e7975c26c0b66a7b761aa3b2fe8aa348990

Observation d5d66f28-4c3d-4039-9f6d-cc525750cd45 · inbound

Performance Analysis of Traditional VQA Models Under Limited Computational Resources cites this paper.

Performance Analysis of Traditional VQA Models Under Limited Computational Resources TinyBERT: Distilling BERT for Natural Language Understanding

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-08T18:10:38.356476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T18:10:38.356476Z digest=sha256:69fcf8a622bd2cdb00eff2d4a01881fcabab2d1267a6f754eb04dc254160ee24

Observation 373c26d2-28b7-4781-a4cf-40710192aefa · inbound

Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile cites this paper.

Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile TinyBERT: Distilling BERT for Natural Language Understanding

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-08T16:36:00.644229Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T16:36:00.644229Z digest=sha256:f927a7f722fbdec891d51bf505c8e5024f3e594874cfbf64767eb8cdba916f8e

Observation ce1c0edc-2323-4c8f-8410-c35cf4074639 · inbound

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers cites this paper.

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers TinyBERT: Distilling BERT for Natural Language Understanding

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-08T12:50:14.699745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T12:50:14.699745Z digest=sha256:eefefc3bcc822cbc7950d4c76564f0d05e93e40c840b5db3e28cec2a8e9f1678

Observation e7aa24e4-5d35-4d94-90f2-cb1c8ed7de4c · inbound

LLM Modules: Knowledge Transfer from a Large to a Small Model using Enhanced Cross-Attention cites this paper.

LLM Modules: Knowledge Transfer from a Large to a Small Model using Enhanced Cross-Attention TinyBERT: Distilling BERT for Natural Language Understanding

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T06:02:46.475725Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T06:02:46.475725Z digest=sha256:f46cf993dec44fc82dbe7840910eac7847df0e8ba8acd41f81a2f420477e637c

Observation bc7090e6-5def-4587-8ef1-73c17f19c09e · inbound

Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices cites this paper.

Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices TinyBERT: Distilling BERT for Natural Language Understanding

Reference 60

Resolution
verified exact
arxiv_id, observed 2026-05-23T01:05:16.228134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-23T01:03:26.037233Z digest=sha256:efd5d74481409c39c10c381fac789d9a259165e75a6d42479796d5959aff082f

Observation d57dda93-a1ef-4eff-b830-5b3a76ccc711 · inbound

A Survey of LLM $\times$ DATA cites this paper.

A Survey of LLM $\times$ DATA TinyBERT: Distilling BERT for Natural Language Understanding

Reference 195

Resolution
unresolved
no resolver link, observed 2026-08-07T14:33:13.230569Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:33:13.230569Z digest=sha256:76f7e0ad5284f3a041b7d001aea309ee7a58c624ba8dad6ed317f9a3cc118ab1

Observation b72f986e-e1fa-4137-948d-6f3944b454e4 · inbound

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation cites this paper.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.727608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.727608Z digest=sha256:bd2f231e7444e87347fb68adbbf7368fdd2079d04887f936d7bd8d049208f834

Observation 413efbf6-1e51-488b-8506-895164dbe1c2 · inbound

Avoid Forgetting by Preserving Global Knowledge Gradients in Federated Learning with Non-IID Data cites this paper.

Avoid Forgetting by Preserving Global Knowledge Gradients in Federated Learning with Non-IID Data TinyBERT: Distilling BERT for Natural Language Understanding

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T13:59:35.328167Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:59:35.328167Z digest=sha256:aec1a433bc8c73398c58082a54b5d71425a28ad507ef9a388092c5d90e6b520c

Observation 06505bbb-163b-41d9-ad26-d46938c17af7 · inbound

SEMFED: Semantic-Aware Resource-Efficient Federated Learning for Heterogeneous NLP Tasks cites this paper.

SEMFED: Semantic-Aware Resource-Efficient Federated Learning for Heterogeneous NLP Tasks TinyBERT: Distilling BERT for Natural Language Understanding

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T13:58:00.809775Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:58:00.809775Z digest=sha256:bc50d6d45337aa50fb8f63038069926c0b440fa2c6d4c427186401aaea7e1003

Observation feab6543-dc02-436a-9418-2ff401b5f011 · inbound

AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxes cites this paper.

AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxes TinyBERT: Distilling BERT for Natural Language Understanding

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T00:13:34.496625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:13:34.496625Z digest=sha256:bda9d2e12ab4c2e6a9a74eeee492642b85c7645fb2a7c6477a64e1ac63f91d44

Observation 4080a1aa-4628-45d0-86f8-72a82dbc1432 · inbound

Multimodal Medical Image Binding via Shared Text Embeddings cites this paper.

Multimodal Medical Image Binding via Shared Text Embeddings TinyBERT: Distilling BERT for Natural Language Understanding

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T23:28:09.248145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T23:28:09.248145Z digest=sha256:71b0d4e43c50c0e5cba536fe13019c85063699aae8763c3524fc5b3c5b28ce03

Observation b0863a24-7ce6-402e-ad61-f9d56865dff2 · inbound

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration cites this paper.

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration TinyBERT: Distilling BERT for Natural Language Understanding

Reference 111

Resolution
unresolved
no resolver link, observed 2026-08-06T21:16:14.869832Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:16:14.869832Z digest=sha256:10f732b8ea4297864f9cc1693df80fa7c2ebee04ca038d0c8a67ca7dae8b2e3a

Observation 51299067-fb77-4527-87fd-a9989287bef0 · inbound

MobileRAG: A Fast, Memory-Efficient, and Energy-Efficient Method for On-Device RAG cites this paper.

MobileRAG: A Fast, Memory-Efficient, and Energy-Efficient Method for On-Device RAG TinyBERT: Distilling BERT for Natural Language Understanding

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T21:11:18.365225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:11:18.365225Z digest=sha256:2aead807643ee5f0d74f216676f712aad66b686f377ac0f3aa7af99442d4550e

Observation f213d2be-3a68-4035-8326-733f47f762ef · inbound

Collaborative Distillation Strategies for Parameter-Efficient Language Model Deployment cites this paper.

Collaborative Distillation Strategies for Parameter-Efficient Language Model Deployment TinyBERT: Distilling BERT for Natural Language Understanding

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T15:42:59.790511Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T15:42:59.790511Z digest=sha256:a25ebc06fbd63c5c7a0d2e805962e901e70b24e8af24714b5b0ed886547f0116

Observation 1830bc6a-bdb2-4108-8f5a-0332b13c47ad · inbound

Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study cites this paper.

Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study TinyBERT: Distilling BERT for Natural Language Understanding

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T13:22:45.689017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:22:45.689017Z digest=sha256:d6c42cafe01727cbe28b94116ce1f9930065a025065ac57b0f98bcfe0cda8a7a

Observation 210e109c-ec36-4528-9e09-d2ffdadc1c6c · inbound

Enhanced Arabic Text Retrieval with Attentive Relevance Scoring cites this paper.

Enhanced Arabic Text Retrieval with Attentive Relevance Scoring TinyBERT: Distilling BERT for Natural Language Understanding

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T10:52:31.903894Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T10:52:31.903894Z digest=sha256:84f908d2e4352c4ad73585b53be95fb1db2739d793ea976d30a06a43a73ce57b

Observation 858073bb-8429-478c-91b5-ebf573f0bb11 · inbound

Resource-Efficient Automatic Software Vulnerability Assessment via Knowledge Distillation and Particle Swarm Optimization cites this paper.

Resource-Efficient Automatic Software Vulnerability Assessment via Knowledge Distillation and Particle Swarm Optimization TinyBERT: Distilling BERT for Natural Language Understanding

Reference 83

Resolution
unresolved
no resolver link, observed 2026-08-06T11:27:32.267226Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T11:27:32.267226Z digest=sha256:b58125075124a56417ec9d627738bb171d2cb99db543157b4a5c2e640a7ad36f

Observation 50948628-fe2d-49e4-9389-c22a0c660fab · inbound

Model Compression vs. Adversarial Robustness: An Empirical Study on Language Models for Code cites this paper.

Model Compression vs. Adversarial Robustness: An Empirical Study on Language Models for Code TinyBERT: Distilling BERT for Natural Language Understanding

Reference 66

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T00:01:55.886217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-19T00:01:42.228190Z digest=sha256:f921c0a63c732c0626280514328e17f5b29626ffcfe3f013883d53fa54db0267

Observation 0da92d69-bef4-4ab0-bc68-d82858b0e5ab · inbound

GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay cites this paper.

GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay TinyBERT: Distilling BERT for Natural Language Understanding

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-05T23:54:24.707388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T23:54:24.707388Z digest=sha256:4ede2fb94b9295d908e3d71239a9cd0a3ee8aa70b0d0ef3862a08048fcff995d

Observation d8128c1a-2a38-4318-bbd4-2abaaddc6114 · inbound

Expandable Residual Approximation for Knowledge Distillation cites this paper.

Expandable Residual Approximation for Knowledge Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-05T17:36:35.500315Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T17:36:35.500315Z digest=sha256:d353a099dcb06c4fd2d994987a42f3f5447ed72c0e74a98374ea2fc3f50059ef

Observation d237722c-20c3-403a-ac7a-1da6da367d4c · inbound

AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models cites this paper.

AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models TinyBERT: Distilling BERT for Natural Language Understanding

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-05T17:14:33.745393Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T17:14:33.745393Z digest=sha256:f963a7c595511f45875d014a7ddfd5da256b2ca29369c172724c88573bf22f34

Observation b7aeb654-9cd3-46e7-83dc-de4c244da4c5 · inbound

NoteBar: An AI-Assisted Note-Taking System for Personal Knowledge Management cites this paper.

NoteBar: An AI-Assisted Note-Taking System for Personal Knowledge Management TinyBERT: Distilling BERT for Natural Language Understanding

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-05T10:52:45.911394Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T10:52:45.911394Z digest=sha256:da23163d09f029191131fef9a2f234007983004e0e0a4c9fc5accd7cd9b03171

Observation e6bbc0f2-1356-4fd9-a4f1-857604417b4e · inbound

A Transformer-Based Cross-Platform Analysis of Public Discourse on the 15-Minute City Paradigm cites this paper.

A Transformer-Based Cross-Platform Analysis of Public Discourse on the 15-Minute City Paradigm TinyBERT: Distilling BERT for Natural Language Understanding

Reference 27

Resolution
verified exact
arxiv_id, observed 2026-05-18T16:16:36.217715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-18T16:15:01.855868Z digest=sha256:5f9c5b6920c77846a74264daccec961c50034899c4f58679a41a604acc9735ac

Observation 87a1f58e-ccfe-468b-b62d-2d466a45d9e4 · inbound

SindBERT, the Sailor: Charting the Seas of Turkish NLP cites this paper.

SindBERT, the Sailor: Charting the Seas of Turkish NLP TinyBERT: Distilling BERT for Natural Language Understanding

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-04T08:22:13.706114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T08:22:13.706114Z digest=sha256:a88f04c9b68e5d9da21584f2ce7a3396d10e3e87e847824f3b239fadf50ca0f1

Observation 08ab6e3d-1215-4d0b-9214-ffffe228da45 · inbound

A Metamorphic Testing Perspective on Knowledge Distillation for Language Models of Code: Does the Student Deeply Mimic the Teacher? cites this paper.

A Metamorphic Testing Perspective on Knowledge Distillation for Language Models of Code: Does the Student Deeply Mimic the Teacher? TinyBERT: Distilling BERT for Natural Language Understanding

Reference 79

Resolution
verified exact
arxiv_id, observed 2026-05-17T23:50:31.910688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-17T23:45:54.490984Z digest=sha256:740efefa722a5701ca2953e745daeee12d687e54cc682ff1a3e608494dc82f33

Observation e81fdd76-2874-486f-8294-cf930d67f605 · inbound

DynamiQ: Accelerating Gradient Synchronization using Compressed Multi-hop All-reduce cites this paper.

DynamiQ: Accelerating Gradient Synchronization using Compressed Multi-hop All-reduce TinyBERT: Distilling BERT for Natural Language Understanding

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-03T03:13:22.046513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T03:13:22.046513Z digest=sha256:3efb1e73f4c3f31486f22071f9e2a7f8b0f72a2490b90e151e70b5e7d6405781

Observation b19253c8-5427-456c-bcc5-96d4f0c1992e · inbound

FHECore: Rethinking GPU Microarchitecture for Fully Homomorphic Encryption cites this paper.

FHECore: Rethinking GPU Microarchitecture for Fully Homomorphic Encryption TinyBERT: Distilling BERT for Natural Language Understanding

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-03T03:04:21.095337Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T03:04:21.095337Z digest=sha256:bebbd5c98fad6e6e85e49ddcd2b3a9327c1fa5d9eefc98f3781404eeddf931ac

Observation b05ea3eb-6ec7-4d2f-95e4-85934b8466e8 · inbound

A Comparative Study of Semantic Log Representations for Software Log-based Anomaly Detection cites this paper.

A Comparative Study of Semantic Log Representations for Software Log-based Anomaly Detection TinyBERT: Distilling BERT for Natural Language Understanding

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-11T05:25:59.667742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-10T18:08:20.298349Z digest=sha256:1bf3f3db2fbc4b977a5eb26608d3ffb1d97a8a684f162f32567a011399e69340

Observation 96155bb0-3b50-42ec-8494-a2a28fc3ce7e · inbound

Modular Representation Compression: Adapting LLMs for Efficient and Effective Recommendations cites this paper.

Modular Representation Compression: Adapting LLMs for Efficient and Effective Recommendations TinyBERT: Distilling BERT for Natural Language Understanding

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-11T12:06:04.762349Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-10T04:09:10.125285Z digest=sha256:8fc914c1341c969d181f6176382b606b3624aa581d106fff1970e4013746dc5d

Observation 25f667af-963c-44d0-94c7-a96028d9ad73 · inbound

ESsEN: Training Compact Discriminative Vision-Language Transformers in a Low-Resource Setting cites this paper.

ESsEN: Training Compact Discriminative Vision-Language Transformers in a Low-Resource Setting TinyBERT: Distilling BERT for Natural Language Understanding

Reference 30

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T11:56:18.735494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-10T04:28:38.775948Z digest=sha256:6356a0792896745a974d03372f17beb43348dd459c1ef4eba15ec8943bd9c1b1

Observation 66b9c556-8e2a-470e-9d30-7d28d44f40b7 · inbound

TabEmb: Joint Semantic-Structure Embedding for Table Annotation cites this paper.

TabEmb: Joint Semantic-Structure Embedding for Table Annotation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 42

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T12:41:02.293181Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-10T03:18:46.913340Z digest=sha256:e9ab63402944540c5980268d49ebc4842e3d9bd1128791ec839cd4aa60c5182a

Observation 982c30a7-9243-462e-94c6-e5a1760b57e7 · inbound

SRA: Span Representation Alignment for Large Language Model Distillation cites this paper.

SRA: Span Representation Alignment for Large Language Model Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-11T16:41:15.928397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-09T15:22:14.289423Z digest=sha256:b0a8a5051c1f9912f5d87eb06a84bb83d630e0901ecb29ff73b2334e27bbd498

Observation 65cc1a51-536f-4b18-8c49-1fafad3490d1 · inbound

MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation cites this paper.

MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-11T16:51:05.530831Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-09T14:55:26.285575Z digest=sha256:476266e816426c8357d4b2146e8646bfd519ec841925cfdae8ebc7bc8d19e00e

Observation 37118c6b-3d65-4292-bb06-05684e865599 · inbound

MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation cites this paper.

MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T00:35:10.324216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-01T00:30:26.371099Z digest=sha256:356e26129b9ced6c89b4e5451a03597da0f616690b0b7b35fbff2d3dedc72924

Observation bd571544-d7bf-4504-8218-fcae17f48a5a · inbound

Combining pre-trained models via localized model averaging cites this paper.

Combining pre-trained models via localized model averaging TinyBERT: Distilling BERT for Natural Language Understanding

Reference 150

Resolution
metadata mismatch
arxiv_id, observed 2026-05-14T17:57:33.001244Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-14T17:56:34.111280Z digest=sha256:6d268e395b3da59777056044462416d5c4636d40f6e72cc3b086ae793f41be9e

Observation 5383e0ad-9bee-4442-a9b1-b14883139966 · inbound

BiSpikCLM: A Spiking Language Model integrating Softmax-Free Spiking Attention and Spike-Aware Alignment Distillation cites this paper.

BiSpikCLM: A Spiking Language Model integrating Softmax-Free Spiking Attention and Spike-Aware Alignment Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-05-15T07:15:11.707359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-15T07:11:46.177353Z digest=sha256:8d9da065fdfd96ab164c1827c3483eb91b6a17708ae7b9bf92452742caf53640

Observation 0972ee65-ebb9-416a-9456-b21e26496ef5 · inbound

Fast Tensorization of Neural Networks via Slice-wise Feature Distillation cites this paper.

Fast Tensorization of Neural Networks via Slice-wise Feature Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-20T06:53:22.956232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-20T06:53:09.576838Z digest=sha256:d51a842b97563e53356e85616e3261eb15290231ce044b3843f6392ecc9365b6

Observation 4582d3fa-d37a-48e4-8a69-d02152f30f1f · inbound

When Mean CE Fails: Median CE Can Better Track Language Model Quality cites this paper.

When Mean CE Fails: Median CE Can Better Track Language Model Quality TinyBERT: Distilling BERT for Natural Language Understanding

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-06-30T13:24:39.948088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-30T13:23:55.114628Z digest=sha256:7e44e0c6ba179c25d3074e619706f0a497130627934bf3d549a9ba9cbe3781e2

Observation 9a691f3c-2803-4f4c-9062-949e31d62082 · inbound

Bounded Behavioral Indistinguishability for Black-Box LLM Distillation cites this paper.

Bounded Behavioral Indistinguishability for Black-Box LLM Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-06-29T08:53:15.420960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-29T08:50:41.083288Z digest=sha256:5c5eb8254c41bf4069fcc41fea86f3e44f68bb10b74a0f3015f17204fb21ee9f

Observation 101f88cd-8ca6-46fd-8d10-41e327910293 · inbound

Do Transformers Need Three Projections? Systematic Study of QKV Variants cites this paper.

Do Transformers Need Three Projections? Systematic Study of QKV Variants TinyBERT: Distilling BERT for Natural Language Understanding

Reference 49

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T22:36:17.296567Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-28T15:14:49.475561Z digest=sha256:bc03d507b01c610ff6c8b69dbab2e3d231dc803401a1b8186130079154652b2a

Observation 8b7baf1f-7b74-4503-b001-f22cd9be71ac · inbound

Minimizing the Hidden Cost of Scales: Graph-Guided Ultra-Low-Bit Quantization for Large Language Models cites this paper.

Minimizing the Hidden Cost of Scales: Graph-Guided Ultra-Low-Bit Quantization for Large Language Models TinyBERT: Distilling BERT for Natural Language Understanding

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-07-02T08:16:48.231919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-28T06:09:42.838355Z digest=sha256:b85da7bfb350766dc2640c995bf5cd8d7ac20fab265ffa3a4c2f883cefb27aa8

Observation 92c8bb65-0867-4c60-a7f2-1002beef1905 · inbound

Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models cites this paper.

Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models TinyBERT: Distilling BERT for Natural Language Understanding

Reference 127

Resolution
metadata mismatch
arxiv_id, observed 2026-07-03T00:27:29.554567Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-27T17:13:46.335347Z digest=sha256:fe24cd77105211fb89ef723491dce0db79d3e9e858882c3f8e86f89d2eb68130

Observation b8452aba-1e81-4f52-a05e-fcd27ad94a34 · inbound

Toward Calibrated, Fair, and accurate Deepfake Detection cites this paper.

Toward Calibrated, Fair, and accurate Deepfake Detection TinyBERT: Distilling BERT for Natural Language Understanding

Reference 65

Resolution
metadata mismatch
arxiv_id, observed 2026-06-28T07:11:45.313693Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-28T07:05:18.026601Z digest=sha256:2c2f82c31f6c16bc59420a22ebe7177802655c2f698f54dbd0fddd26a9222f77

Observation b9da8958-fc6c-43ac-9bc2-c410d7e443c2 · inbound

TALAS: Teacher-Anchored Layer Alignment with Adaptive Sharpness-Aware Minimization for Embedding Distillation cites this paper.

TALAS: Teacher-Anchored Layer Alignment with Adaptive Sharpness-Aware Minimization for Embedding Distillation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-07-04T07:59:40.474904Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-26T12:18:01.779039Z digest=sha256:2807231050705aca2e623acd40622d8aad43a53b0f6f72190f42e3962200e608

Observation c2e91149-e5b7-4028-a0bc-ac0aa346ec15 · inbound

Unified Multi-Task Relevance Modeling for E-Commerce: Comparing Task Routing Architectures Across LLMs and Cross-Encoders cites this paper.

Unified Multi-Task Relevance Modeling for E-Commerce: Comparing Task Routing Architectures Across LLMs and Cross-Encoders TinyBERT: Distilling BERT for Natural Language Understanding

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-07-04T12:49:51.880172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-26T06:08:27.696658Z digest=sha256:e8757afd5f6c2aef7c2d665a329471de4d02d1041f582d4bba5bbde797723879

Observation 93f2dabb-d093-45ba-a4b3-d0f97a909f9c · inbound

Data Provenance for Image Auto-Regressive Generation cites this paper.

Data Provenance for Image Auto-Regressive Generation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 106

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T10:34:36.631239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-06-30T10:28:59.577056Z digest=sha256:941b33d5ebf4cea14cc85cde1193bd9643f389e4f2f43c371d7484bfe0cb773f

Observation 404ba290-802b-4ef5-9456-d52bc53c03e5 · inbound

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers cites this paper.

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers TinyBERT: Distilling BERT for Natural Language Understanding

Reference 21

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T15:07:03.975713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-07-02T15:03:00.874505Z digest=sha256:26c93268cc9a39ab125e7f4caaaa6ec003be023588a5c6e768c8acb4d876d61c