Pith. sign in

Paper Citation Record · LEDGER

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 23 inbound Pith citation observations for arXiv:2212.05055.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2212.05055 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 23 of 23 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T11:20:23.627982Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

12
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 67431689-0637-42ec-a05c-6925b5ded578 · inbound

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints cites this paper.

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 48

Resolution
verified exact
arxiv_id, observed 2026-05-11T06:53:59.369167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-11T06:53:58.960357Z digest=sha256:cf2619b3146feeb6a0fe476264ca456200e1d529619100a2d9dadff666157aed

Observation df4dd422-f982-4b2e-a421-ca6db158304c · inbound

MoE-LLaVA: Mixture of Experts for Large Vision-Language Models cites this paper.

MoE-LLaVA: Mixture of Experts for Large Vision-Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 15

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T02:33:30.309336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-16T02:33:30.143907Z digest=sha256:7a64fe446b3ce2e3619897309da99b68511965aea21c3b0369dc9967b7e218a2

Observation 56704cea-9f6c-4252-81d6-88872d84893d · inbound

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies cites this paper.

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-05-13T18:00:53.537329Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-13T18:00:53.389420Z digest=sha256:fad3ec3a56c216110ec95509de238d11a8a891edb287579ceb7a9dbb4da978a5

Observation c041c756-97d8-414c-af0e-3c4532ca826f · inbound

A Survey on Efficient Inference for Large Language Models cites this paper.

A Survey on Efficient Inference for Large Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 91

Resolution
verified exact
arxiv_id, observed 2026-05-15T02:39:33.232205Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-15T02:39:33.007894Z digest=sha256:ec19e254ddf4e06a1c73863dce71e9c2e712e8969de740750671a2ee3e142102

Observation 6f0a874f-b08c-46e0-93b3-a2d5562c126d · inbound

Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis cites this paper.

Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 18

Resolution
verified exact
arxiv_id, observed 2026-05-23T04:12:31.096197Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-23T04:08:29.089438Z digest=sha256:7603d3b89f80befaee23ec3ca665be438ba1ea5c063bb85c90853ae095105da0

Observation 04f50ded-00a7-460e-935f-a8e016755d0e · inbound

Training Sparse Mixture Of Experts Text Embedding Models cites this paper.

Training Sparse Mixture Of Experts Text Embedding Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-08T11:20:23.627982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T11:20:23.627982Z digest=sha256:710c76470f8d983615540788d8cddd8ebf9d0f6a804a51efe32573e9790f44fa

Observation add9a803-4985-4aa2-9871-2832581282d2 · inbound

Mixture-of-Experts Can Surpass Dense LLMs Under Strictly Equal Resource cites this paper.

Mixture-of-Experts Can Surpass Dense LLMs Under Strictly Equal Resource Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 19

Resolution
verified exact
arxiv_id, observed 2026-05-22T00:05:47.760189Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-22T00:05:08.916339Z digest=sha256:82eb0c615022b5f281c1446fadf6ce31f8a374535f207398bd095085541a12b8

Observation 277012d9-716a-4bd7-abd1-de2f81775792 · inbound

SpikingBrain: Spiking Brain-inspired Large Models cites this paper.

SpikingBrain: Spiking Brain-inspired Large Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-18T18:51:45.676873Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-18T18:51:06.243305Z digest=sha256:ede6cd142b3bad7a9210848c5db225664cbc9242544a78e917f7922655e646ac

Observation 243a998b-784f-4ebc-ae15-bca7d1e43c11 · inbound

Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts cites this paper.

Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 25

Resolution
verified exact
arxiv_id, observed 2026-05-10T03:29:21.454800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-10T03:29:16.555166Z digest=sha256:8dab70cebc5cd3eddded652069941d311a646385c6288c0ec86a4c1c66255d03

Observation 14ed15c8-2a8e-4c1f-944b-0fa2b58d5e0f · inbound

Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts cites this paper.

Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 25

Resolution
verified exact
arxiv_id, observed 2026-05-12T02:06:15.330760Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-12T02:03:02.654035Z digest=sha256:fcdd1b05a8925a680dfd29632fd200dd85a95aba1d62ff10248c5394dcc93466

Observation 2cdf9ed4-ec0b-4c69-aeb3-2717b7a78f4c · inbound

HodgeCover: Higher-Order Topological Coverage Drives Compression of Sparse Mixture-of-Experts cites this paper.

HodgeCover: Higher-Order Topological Coverage Drives Compression of Sparse Mixture-of-Experts Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 30

Resolution
verified exact
arxiv_id, observed 2026-05-15T05:55:04.804235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-15T05:54:32.496951Z digest=sha256:f9ca46eb3c08a60d78db934ceae777906d54ea54d196952b18ceedeb64f0f241

Observation 411bc5a4-1c53-437d-a038-161510294170 · inbound

Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling cites this paper.

Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-06-29T19:43:55.024776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-29T19:34:17.270161Z digest=sha256:f18acd8b82f41884f642463d0e7fde36e38ed24241d92b1408f0fa3d73604ac7

Observation 9b7f1f9f-bc4c-4b2f-94ae-612a300fab00 · inbound

Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models cites this paper.

Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 17

Resolution
verified exact
arxiv_id, observed 2026-07-01T19:26:00.040544Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-28T22:43:33.929871Z digest=sha256:54e0ab76da74cd1e7f960f8e05895438a5718b0521902d6b8cbbe723dd8c5709

Observation 7b902ecc-0357-479a-8112-0b8d402e17ee · inbound

Reversible Foundations: Training a 120B Sparse MoE through State-Preserving Scaling cites this paper.

Reversible Foundations: Training a 120B Sparse MoE through State-Preserving Scaling Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 49

Resolution
verified exact
arxiv_id, observed 2026-07-02T16:07:09.420797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-27T22:55:09.477413Z digest=sha256:5cccd600dedb218d66c9e2f45748d5b10850757310147a49ed3ff9ffd331ef49

Observation a217183e-a6fe-4e15-8af5-82bc0caf9123 · inbound

Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs cites this paper.

Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 197

Resolution
metadata mismatch
arxiv_id, observed 2026-07-03T01:07:30.270932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-27T16:49:14.243931Z digest=sha256:4131482930cbf6c734b77828331d738f876774f9c597e67491eb8fcd918d7be2

Observation 165e8b90-51e0-4b77-b0be-2e47efa18e5a · inbound

PADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student Learning cites this paper.

PADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student Learning Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 18

Resolution
metadata mismatch
arxiv_id, observed 2026-07-03T05:27:39.751050Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-27T13:18:41.596372Z digest=sha256:e132de0dcea76a7daea33c9f0ba1d5f7ffb6a0b8556cd960e6c0c3ddf70923d7

Observation fec9ca77-1ce8-4142-b12f-91919d556491 · inbound

Behavioral and Representational Evidence of Binomial Ordering Preferences in Large Language Models cites this paper.

Behavioral and Representational Evidence of Binomial Ordering Preferences in Large Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 9

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T06:39:37.844241Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-26T14:18:11.215278Z digest=sha256:6162610f3e67fc97af10b74a725faf5113f2fc69274ae2eee43c8d8f252aa886

Observation e307e6d8-b21f-4c43-8e96-2d76a4f0c5ad · inbound

LLM Evolution as an Industry-Scale Ecosystem: A Lifecycle Perspective on Continual Learning cites this paper.

LLM Evolution as an Industry-Scale Ecosystem: A Lifecycle Perspective on Continual Learning Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 54

Resolution
verified exact
arxiv_id, observed 2026-07-03T16:48:39.909349Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-27T05:02:18.347642Z digest=sha256:5d661de29aaa3b574565bc90770c80c15a61db17dea969850e1551ba7c7df6a8

Observation f82ce639-7bc7-41db-af5d-7f85c2da1d68 · inbound

GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models cites this paper.

GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 32

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T15:39:56.508142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-26T01:32:40.435742Z digest=sha256:7237efc60830310c1d80d6fe07e7147e8f39907c946fc67aaf86c246c4d4019f

Observation bd9b0fee-c622-4e64-b79e-09f147b71b1a · inbound

Rosetta: Composable Native Multimodal Pretraining cites this paper.

Rosetta: Composable Native Multimodal Pretraining Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 25

Resolution
verified exact
arxiv_id, observed 2026-07-02T15:47:05.759103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-07-02T15:41:13.556849Z digest=sha256:63a0b5561f9c72e466ef89ab19a21a2f904f4da1b09e4a16f4c4f0c3da2c9495

Observation 9f0979a5-30ab-4193-a1fd-ce42ab786fdc · inbound

ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI cites this paper.

ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 126

Resolution
unresolved
no resolver link, observed 2026-07-11T19:16:57.396710Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T19:16:57.396710Z digest=sha256:ede0a9c8464fe15f331fbdf172ceb4e262f0c2b750e62d5ed7ad240241f04284

Observation b7d7e243-73ff-4194-a052-a263e3d8d0a1 · inbound

MM-ShiftKV: Decode-Aware Prefill-Stage KV Selection for Multimodal Large Language Models cites this paper.

MM-ShiftKV: Decode-Aware Prefill-Stage KV Selection for Multimodal Large Language Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 87

Resolution
unresolved
no resolver link, observed 2026-08-02T11:58:30.699815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-02T11:58:30.699815Z digest=sha256:a6fc97107f9d1a2845fa8106183b4b83dbb2b4a11743f6606d2d8696d64cd86c

Observation 8df7d279-6abf-4491-a22b-8809a8729a3d · inbound

SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models cites this paper.

SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-02T10:18:55.487992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T10:18:55.487992Z digest=sha256:67aee2b5ec8a97318aeeb8fd3e896da2cf7b145b03fcb7a1842155af9b21e0fb