Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-12T17:40:11.880130Z
Paper Citation Record · LEDGER
As of 16 August 2026, this Paper Citation Record lists 46 of 46 outbound references and 9 inbound Pith citation observations for arXiv:2411.12364.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-12T17:40:11.880130Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-11T12:03:42.481591Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-07-04T01:09:19.454543Z
46 of 46 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 49dd7439-157b-4e5c-a064-76f8c89ed5ba · outbound
Ultra-Sparse Memory Network Singular value decomposition (svd) and generalized singular value decomposition
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 90d13969-5966-4fde-9ac7-57bc76824daa · outbound
Ultra-Sparse Memory Network GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 168cae66-14e8-4f63-a909-ba55dd778b30 · outbound
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6d40994-6891-41eb-9625-ab09f9c52583 · outbound
Ultra-Sparse Memory Network LoTR: Low Tensor Rank Weight Adaptation
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e02b3f88-803a-4aff-b065-4a1b7452254c · outbound
Ultra-Sparse Memory Network GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f701ef5f-3caf-4fb8-b0bb-0dc73efae480 · outbound
Ultra-Sparse Memory Network Language Models are Few-Shot Learners
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e50a5810-8fa1-4aa3-bb7f-1b75b55a83d0 · outbound
Ultra-Sparse Memory Network On the representation collapse of sparse mixture of experts
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9225d8b9-6342-4e42-bf6d-afab1d4231aa · outbound
Ultra-Sparse Memory Network BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dcba7540-6c9f-485d-a8ba-1bab9920f714 · outbound
Ultra-Sparse Memory Network Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 56d6fdc6-72b9-4807-9a98-95aa69ef0e86 · outbound
Ultra-Sparse Memory Network Redpajama: An open source recipe to reproduce llama training dataset, 2023
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c6f7d534-4cca-42e0-88f7-859593b37b3e · outbound
Ultra-Sparse Memory Network Approximating Two-Layer Feedforward Networks for Efficient Transformers
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 793ab649-2840-47a9-8a7f-57020a0cda5c · outbound
Ultra-Sparse Memory Network DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 38f6861d-5427-4df1-8efd-9bfc4aa2b7e4 · outbound
Ultra-Sparse Memory Network DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bb380a63-bb88-450b-bef9-61fcf15e1dc0 · outbound
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 837ad763-237e-40b5-86f9-b6359c37b3cc · outbound
Ultra-Sparse Memory Network Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7cae23e5-68a7-4d02-8b71-e25c2c3a5bab · outbound
Ultra-Sparse Memory Network Transformer Feed-Forward Layers Are Key-Value Memories
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 38ad07e4-8279-44d0-83b1-d549a73128b0 · outbound
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 01cad70a-52e7-4f86-b8b2-86e9405c7870 · outbound
Ultra-Sparse Memory Network Measuring Massive Multitask Language Understanding
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0bbf8997-344a-4614-988d-05df52dec7fc · outbound
Ultra-Sparse Memory Network MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c98a8dd7-81f7-456d-b2a3-3491cabf162f · outbound
Ultra-Sparse Memory Network Product quantization for nearest neighbor search
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cf2fe7cc-3dc0-41af-be00-b9f54fccc2b7 · outbound
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5b6a5c7-2924-4699-b298-f3874bedbd2a · outbound
Ultra-Sparse Memory Network TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation eef2b7ce-bc41-4ad5-b63d-54980cf762fe · outbound
Ultra-Sparse Memory Network Large Product Key Memory for Pretrained Language Models
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 55220a9d-b5c6-428f-b64d-973a86cb10ba · outbound
Ultra-Sparse Memory Network Scaling Laws for Fine-Grained Mixture of Experts
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e15c0b11-7d9b-4a29-9f09-9ae6a723a9e6 · outbound
Ultra-Sparse Memory Network Large memory layers with product keys
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7b815b85-e9ab-4701-9624-96aa1d4dbaf3 · outbound
Ultra-Sparse Memory Network DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c08f18c0-0d65-408f-a388-7880799ec553 · outbound
Ultra-Sparse Memory Network Low-rank tucker decomposition of large tensors using tensorsketch
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a522919e-9bde-4b9d-a226-9c561f661c50 · outbound
Ultra-Sparse Memory Network Efficient large-scale language model training on gpu clusters using megatron-lm
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ceec7ec9-9da3-4730-aa58-35fd6a9fada6 · outbound
Ultra-Sparse Memory Network Language models are unsupervised multitask learners
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fe2f46d1-93fb-4e1b-a590-a890f30b35b8 · outbound
Ultra-Sparse Memory Network Exploring the limits of transfer learning with a unified text-to-text transformer
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5098089c-cb9e-413e-9e15-15daad3e080b · outbound
Ultra-Sparse Memory Network Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a5b61079-0425-4b16-b1ea-b59d91fae9c9 · outbound
Ultra-Sparse Memory Network GPQA: A Graduate-Level Google-Proof Q&A Benchmark
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7991625d-3965-4cba-8660-45da45170c0b · outbound
Ultra-Sparse Memory Network Hash layers for large sparse models
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 417f0688-3ddf-4135-bc75-1ce52165397e · outbound
Ultra-Sparse Memory Network Winogrande: An adversarial winograd schema challenge at scale
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3dda8bfd-b93f-4cd4-acdc-4f3e3cbdf1ec · outbound
Ultra-Sparse Memory Network Neural Machine Translation of Rare Words with Subword Units
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6eeeeeb-0339-4fe8-915d-adba2ce6b7c8 · outbound
Ultra-Sparse Memory Network Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4178765d-a19c-4b53-a8a4-42790ac2b85a · outbound
Ultra-Sparse Memory Network A Study on ReLU and Softmax in Transformer
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b268acff-ebab-4aa8-a23e-1dc64dfbd0e8 · outbound
Ultra-Sparse Memory Network Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d8b17f34-6df3-4d25-96fd-30cbe79577db · outbound
Ultra-Sparse Memory Network Roformer: Enhanced transformer with rotary position embedding
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2798ba0c-1687-4752-802c-a3c2dcf5fba7 · outbound
Ultra-Sparse Memory Network Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a8de3515-0ce9-4973-8b3e-a78c8e442842 · outbound
Ultra-Sparse Memory Network LLaMA: Open and Efficient Foundation Language Models
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d430c2f1-83cc-4949-a235-da421349aa98 · outbound
Ultra-Sparse Memory Network On layer normalization in the transformer architecture
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1bd81ccb-27cc-4159-b932-60140161e6cb · outbound
Ultra-Sparse Memory Network HellaSwag: Can a Machine Really Finish Your Sentence?
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f964a509-040d-4db2-8c1f-3416831f6264 · outbound
Ultra-Sparse Memory Network AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a166d638-22f7-4ea9-8a54-d8577b75451c · outbound
Ultra-Sparse Memory Network Mixture-of-experts with expert choice routing
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 57c341e5-e6ae-4d34-b417-20149107f429 · outbound
Ultra-Sparse Memory Network write newline
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2b074278-78de-4f66-a8ea-d8d8537c3e3c · inbound
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing Ultra-Sparse Memory Network
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ab689d32-1985-4586-bc5b-1776e1733e0c · inbound
Unveiling Instruction-Specific Neurons & Experts: An Analytical Framework for LLM's Instruction-Following Capabilities Ultra-Sparse Memory Network
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e8ecbb92-aa3c-432f-9a7c-a9f8c04ef171 · inbound
UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning Ultra-Sparse Memory Network
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9a4381f8-292a-496d-8f4e-52436d4de2cd · inbound
MIDUS: Memory-Infused Depth Up-Scaling Ultra-Sparse Memory Network
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 05776b31-66e4-4652-bfcc-c8b9859efb31 · inbound
Memory Grafting: Scaling Language Model Pre-training via Offline Conditional Memory Ultra-Sparse Memory Network
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 4b42034b-fa73-4903-833d-76720aa0da34 · inbound
SinkRec: Mitigating Semantic State Sink in Long Sequence Recommendation with Memory-Conditioned Gated Delta Networks Ultra-Sparse Memory Network
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 07965896-2fa1-4712-ae28-18f94b5ae216 · inbound
Augmenting Molecular Language Models with Local $n$-gram Memory Ultra-Sparse Memory Network
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation 3ef7cfa3-82d5-4c3d-af11-1ef9450c970d · inbound
User as Engram: Internalizing Per-User Memory as Local Parametric Edits Ultra-Sparse Memory Network
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.
Observation e364a06c-7f2d-4cab-aeaf-bc5df9d406ab · inbound
Train Smarter, Not Longer: Memorization-Guided Data Reuse for Efficient LLM Training Ultra-Sparse Memory Network
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.