Pith. sign in

Paper Citation Record · LEDGER

LOST: Low-rank and Sparse Pre-training for Large Language Models

As of 15 August 2026, this Paper Citation Record lists 46 of 46 outbound references and 8 inbound Pith citation observations for arXiv:2508.02668.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.02668 v1

Coverage vector

measured 46 of 46 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T17:44:20.123934Z

measured 54 of 54 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T06:01:14.921682Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-10T02:06:42.157809Z

Reference resolution

46 of 46 outbound references displayed

  • verified exact0
  • verified fuzzy10
  • unresolved36
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 653e2635-a16e-4d75-b532-157bfb08ee6a · outbound

This paper cites From words to watts: Benchmarking the energy costs of large language model inference.

LOST: Low-rank and Sparse Pre-training for Large Language Models From words to watts: Benchmarking the energy costs of large language model inference

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.975978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:19.921716Z digest=sha256:7c5b0b7e5b8504a9e5d2729659f27622c329633160b5c28438c7d13a555a0aae

Observation f23d8d50-c46a-4ffa-bcfd-51bcbc315a77 · outbound

This paper cites Lora: Low-rank adaptation of large language models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Lora: Low-rank adaptation of large language models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.928432Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.928432Z digest=sha256:2e13f9a5e17e471156ac220aa29a45006e9d9a314e7d12e07b433687cc9fd5b3

Observation c49d1c7f-7aa2-4255-b26d-8bdb5643372f · outbound

This paper cites Adaptive budget allocation for parameter-efficient fine-tuning.

LOST: Low-rank and Sparse Pre-training for Large Language Models Adaptive budget allocation for parameter-efficient fine-tuning

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.933961Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.933961Z digest=sha256:632f23195bb5568f17bbe270baa952d648da90ee891abd0c232f30eb4319f564

Observation 1eb9db9f-e9fc-4a14-991e-c238ebc1a325 · outbound

This paper cites Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying.

LOST: Low-rank and Sparse Pre-training for Large Language Models Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.938654Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.938654Z digest=sha256:4ea00323ee05bb565441528ba91f9e1e9fd45efd5e3f34c87d4391a66e65230c

Observation 3b867b7f-f663-4bb4-9db2-8fdb7b139ab2 · outbound

This paper cites S-LoRA: Serving Thousands of Concurrent LoRA Adapters.

LOST: Low-rank and Sparse Pre-training for Large Language Models S-LoRA: Serving Thousands of Concurrent LoRA Adapters

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.943682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.943682Z digest=sha256:b1d98c1fbc658a9bd76b0daf5f0ffd1588160065c2b4b09a024d92ffc4dea054

Observation 479367a4-81b3-4ff0-8794-b7755d974e28 · outbound

This paper cites DoRA: Weight-Decomposed Low-Rank Adaptation.

LOST: Low-rank and Sparse Pre-training for Large Language Models DoRA: Weight-Decomposed Low-Rank Adaptation

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.948554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.948554Z digest=sha256:338f72b0815740bb3e254c4fe404198473421072c37fc9cb7087333c8b2d9e22

Observation 0703212b-4aa1-4d22-8783-926ab7db9cd9 · outbound

This paper cites VeRA: Vector-based Random Matrix Adaptation.

LOST: Low-rank and Sparse Pre-training for Large Language Models VeRA: Vector-based Random Matrix Adaptation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.953651Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.953651Z digest=sha256:07dd8716cddab66c8dcd8fc01dd3ec1c49f4d5eb25441fdf8a8299d8d6f4d18e

Observation d00ccf2c-9f3e-439c-b135-39af7336f0f0 · outbound

This paper cites Qlora: Efficient finetuning of quantized llms.

LOST: Low-rank and Sparse Pre-training for Large Language Models Qlora: Efficient finetuning of quantized llms

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.958401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.958401Z digest=sha256:9327c8b16ff466c443f2e810eadac0c38ca9e00d192d359c8c39a426237e7f7c

Observation 309eec51-1224-43fa-aad6-6084f28ae426 · outbound

This paper cites Initialization and regular- ization of factorized neural layers.

LOST: Low-rank and Sparse Pre-training for Large Language Models Initialization and regular- ization of factorized neural layers

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.930648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:19.963049Z digest=sha256:a4f37c7a9f39602ba0da78fe5d0ff4bcfa71bcdd221c977a007e2679319df35f

Observation 0a56494e-30e8-48cc-8140-8819ceaaf75c · outbound

This paper cites On the Initialisation of Wide Low-Rank Feedforward Neural Networks.

LOST: Low-rank and Sparse Pre-training for Large Language Models On the Initialisation of Wide Low-Rank Feedforward Neural Networks

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.967395Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.967395Z digest=sha256:332ba7aca2e2c9e0581f37dbfba3e9faeff1ce02bf5ddc2896925e2cae68d3c2

Observation c1f8dcf2-c60c-4465-91ff-823ea3ea38ca · outbound

This paper cites Exploring Low Rank Training of Deep Neural Networks.

LOST: Low-rank and Sparse Pre-training for Large Language Models Exploring Low Rank Training of Deep Neural Networks

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.971937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.971937Z digest=sha256:7d98979e6833dba66a6e529e43572afa39676e0848881194b2371eca5b2b8e73

Observation f4a609db-ac42-47f6-81a9-00614a8e714a · outbound

This paper cites Relora: High-rank training through low-rank updates.

LOST: Low-rank and Sparse Pre-training for Large Language Models Relora: High-rank training through low-rank updates

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.916242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:19.976525Z digest=sha256:6ee4ab78b1f9b123857d114f704d8e5db440af9eb738b075f79387ccf225a2e2

Observation 023937b8-2daa-4d79-872f-e23c85288eff · outbound

This paper cites From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications.

LOST: Low-rank and Sparse Pre-training for Large Language Models From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.980700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.980700Z digest=sha256:a786fa5791a275fff0f65671c8fb4c9499cf1dcb869205068353f561b6ec2360

Observation dce4fa70-208c-4224-9b8b-ed52f94270a4 · outbound

This paper cites Investigating low-rank training in transformer language models: Efficiency and scaling analysis.

LOST: Low-rank and Sparse Pre-training for Large Language Models Investigating low-rank training in transformer language models: Efficiency and scaling analysis

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.901928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:19.985049Z digest=sha256:f04babcf1d6488e20b72fe7aca108301bcfb988e5bcd049f4f29f882f9fc28f8

Observation f9bfbb79-d420-4d1f-bacc-1548378ada1a · outbound

This paper cites Full-rank no more: Low-rank weight training for modern speech recognition models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Full-rank no more: Low-rank weight training for modern speech recognition models

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.888036Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:19.989255Z digest=sha256:0e1614c54fde3bf76b87fbee8f75e9d926ac9c69501c085f0473199455bf8154

Observation cd650398-4963-4ded-9624-0102046aa521 · outbound

This paper cites GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection.

LOST: Low-rank and Sparse Pre-training for Large Language Models GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.993388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.993388Z digest=sha256:458fb9a0512a010b5dc9514d0d94c20d3c7f4f28e49e8a49d9b082026642ecbc

Observation d8ae0927-724c-4885-b45f-0d66cdc61c8b · outbound

This paper cites Fira: Can we achieve full-rank training of llms under low-rank constraint? arXiv preprint arXiv:2410.01623, 2024.

LOST: Low-rank and Sparse Pre-training for Large Language Models Fira: Can we achieve full-rank training of llms under low-rank constraint? arXiv preprint arXiv:2410.01623, 2024

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:19.998013Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:19.998013Z digest=sha256:552970f24f1aad7361669e57aaa76dbaef4ddd22e1358cf071f9c45952ae2ff4

Observation 21ef9879-1b50-426c-ae10-2f909a2f3e20 · outbound

This paper cites APOLLO: SGD-like Memory, AdamW-level Performance.

LOST: Low-rank and Sparse Pre-training for Large Language Models APOLLO: SGD-like Memory, AdamW-level Performance

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.002334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.002334Z digest=sha256:68eb25edfaeea355192e5452bd10f1fa7bf2716da8e25080af56e43c7a5e3f36

Observation 07b3e26b-c6b7-4ab6-8c57-a7488d74c387 · outbound

This paper cites Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

LOST: Low-rank and Sparse Pre-training for Large Language Models Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.006961Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.006961Z digest=sha256:eb365e688a2832eff980ae9d08af009124ac2bf5fc99485127ef962f581c7ccf

Observation ce310c51-70c4-4cc9-9cd5-5b12863b6af1 · outbound

This paper cites SLTrain: a sparse plus low rank approach for parameter and memory efficient pretraining.

LOST: Low-rank and Sparse Pre-training for Large Language Models SLTrain: a sparse plus low rank approach for parameter and memory efficient pretraining

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.874153Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:20.011436Z digest=sha256:b3ac9a36a22becab9f53aae4bf62bc43fd9e02f523d09a4719a7f9e9d60d3683

Observation 481246bc-ec1c-48b8-8b9e-b7bcc6a136f9 · outbound

This paper cites Losparse: Structured compression of large language models based on low-rank and sparse approximation.

LOST: Low-rank and Sparse Pre-training for Large Language Models Losparse: Structured compression of large language models based on low-rank and sparse approximation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.015537Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.015537Z digest=sha256:c1463850ae9d12c1653d3b08f83e201cd1cba5d8e371d49c2fbaf4c20a68c1d9

Observation 775de906-647b-46ff-a9dc-7c25d8265aa3 · outbound

This paper cites Dynamic Low-Rank Sparse Adaptation for Large Language Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Dynamic Low-Rank Sparse Adaptation for Large Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.019624Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.019624Z digest=sha256:deecd6e35a9d7ed185191f1fc6bb8486efc97a36c16249e56a8918f7c821bc9b

Observation 0e40d821-8688-444c-8112-c90f61ba3cbb · outbound

This paper cites Sparse Low-rank Adaptation of Pre-trained Language Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Sparse Low-rank Adaptation of Pre-trained Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.024007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.024007Z digest=sha256:e4a1f1016bb259dd9d3bcc6f8583d895c588ef84f7454ff6116b7bdda3c68a63

Observation 1babcc04-b00e-47de-b94c-0006ad552cab · outbound

This paper cites Pissa: Principal singular values and singular vectors adaptation of large language models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Pissa: Principal singular values and singular vectors adaptation of large language models

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.851405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:20.028518Z digest=sha256:4c99c6bbc1db7a0f685155956857b47bff1193b95371ca16967541a014073963

Observation 01dffb2d-65cf-4d65-b454-a57ec7ade47a · outbound

This paper cites LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters.

LOST: Low-rank and Sparse Pre-training for Large Language Models LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.032658Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.032658Z digest=sha256:df713592bea5bdea01b707288b765ef31ddb1982d99bbf39571e15ce503d753c

Observation b389bf80-8f3b-4c60-80a4-906c95d75456 · outbound

This paper cites NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.037368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.037368Z digest=sha256:549db84d0f32a25187056a0793268886ff6dcae8efa27309c795ec26dd0127c3

Observation a9ece71d-9139-4c73-98c9-32e93ab62ffc · outbound

This paper cites Parameter efficient fine-tuning via explained variance adaptation.

LOST: Low-rank and Sparse Pre-training for Large Language Models Parameter efficient fine-tuning via explained variance adaptation

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.041836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.041836Z digest=sha256:d06830aac1c84911279e9d49a6e1fbf25c2477c1d04506d626287b5b3e962803

Observation 316709d5-49ea-40bc-aff3-b62a6857813d · outbound

This paper cites EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition.

LOST: Low-rank and Sparse Pre-training for Large Language Models EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.046020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.046020Z digest=sha256:df2a8ad64c2b334d198080cdb9a0ebe046ba41ae82322ce2a294fc740c1a18c4

Observation fd054f5f-97d6-45b5-ae4d-0e9248a7e069 · outbound

This paper cites Qlora: Efficient finetuning of quantized llms.

LOST: Low-rank and Sparse Pre-training for Large Language Models Qlora: Efficient finetuning of quantized llms

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.050577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.050577Z digest=sha256:841be1d303f4dc595b0e2a69b13c8f1d5874d509d1b99a168aabd11bd8f78922

Observation e66f8373-0d84-44a7-b1eb-d518d337be62 · outbound

This paper cites QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.054800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.054800Z digest=sha256:4ebc7321279dabd7992efc2e9345e705f4f0eebc3df7285fc15d258b8e75d2ec

Observation 9f607441-46e9-482a-bbeb-7059a00d3df5 · outbound

This paper cites LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.059283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.059283Z digest=sha256:7497d21d194a2af79043b177cdda5be0232338769d6745c86de541ab36d293f3

Observation 88e11372-3695-43e5-82e2-bac5eee9ccfe · outbound

This paper cites Pixelated butterfly: Simple and efficient sparse training for neural network models.

LOST: Low-rank and Sparse Pre-training for Large Language Models Pixelated butterfly: Simple and efficient sparse training for neural network models

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.828501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:20.063826Z digest=sha256:ad1403a4be047ff925d2f29b35e0f9b621a698dc133eb202b40f3dddca16a410

Observation 72dc95d8-c7c8-4ef1-a7a8-90a8a797a8b4 · outbound

This paper cites OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition.

LOST: Low-rank and Sparse Pre-training for Large Language Models OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.067925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.067925Z digest=sha256:a5577af05f1fbaa9b09f4bc0a219b5c54bc038accc983793b9e9f106478efd14

Observation 7a2c524c-3dd1-4f7e-a3a8-2ce1de59cfb1 · outbound

This paper cites Robust principal component analysis? Journal of the ACM (JACM), 58(3):1–37, 2011.

LOST: Low-rank and Sparse Pre-training for Large Language Models Robust principal component analysis? Journal of the ACM (JACM), 58(3):1–37, 2011

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.072472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.072472Z digest=sha256:03338128cfaaba4f16f9f70a4812571e030a0463e933177e81ef0414a8a58253

Observation 71852d66-0be9-480d-bbe8-31d0c08372ca · outbound

This paper cites HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMs.

LOST: Low-rank and Sparse Pre-training for Large Language Models HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMs

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.076512Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.076512Z digest=sha256:cce98c09716c8cd26c3f18db0a39c5d48cb572bf18611fe5e28ff32b68b3f8de

Observation 09a150ee-47ee-4fed-b6c7-d75afbf2316a · outbound

This paper cites Parameter and memory efficient pretraining via low-rank riemannian optimization.

LOST: Low-rank and Sparse Pre-training for Large Language Models Parameter and memory efficient pretraining via low-rank riemannian optimization

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.805054Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:20.080957Z digest=sha256:e9c82a4f105a93f584f6a657bd7c17de74cef47bb65da7e95181524aba1bfa88

Observation 70bc2e89-9a5e-448a-8f98-fe1482358d88 · outbound

This paper cites Cola: Compute-efficient pre-training of llms via low-rank activa- tion.

LOST: Low-rank and Sparse Pre-training for Large Language Models Cola: Compute-efficient pre-training of llms via low-rank activa- tion

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.085505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.085505Z digest=sha256:02737d0aea4ccfd27f998f3eff8090afe06a7aad1a7fa7cf542a047ab354fee0

Observation 524183ae-6472-4c77-a1a3-0d5cb17343ca · outbound

This paper cites Delving deep into rectifiers: Surpassing human-level performance on imagenet classification.

LOST: Low-rank and Sparse Pre-training for Large Language Models Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.089552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.089552Z digest=sha256:f55a1a36cce735c57a7afb7b19809e9b66c5b9b4ec712d663b022a60f7c681e6

Observation ddf5e120-3a58-44ac-ad60-b83fb32a9afd · outbound

This paper cites SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression.

LOST: Low-rank and Sparse Pre-training for Large Language Models SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.093532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.093532Z digest=sha256:2ecd326f9c18ad00dbe87d374413bcc723ab7c3df30ea5e0fdc5dde03819c058

Observation dcef69b6-096e-4f6c-a3ca-bafeb2785d8f · outbound

This paper cites Language model compression with weighted low-rank factorization.

LOST: Low-rank and Sparse Pre-training for Large Language Models Language model compression with weighted low-rank factorization

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:44:20.781391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-15T17:44:20.097993Z digest=sha256:eae2259a536ff9dad70ff6581aac2c28e6d98103d8959206e2f70ea5cb782030

Observation 830b6fcd-018b-4a74-9f91-e09280c73814 · outbound

This paper cites Exploring the limits of transfer learning with a unified text-to-text transformer.

LOST: Low-rank and Sparse Pre-training for Large Language Models Exploring the limits of transfer learning with a unified text-to-text transformer

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.102159Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.102159Z digest=sha256:bb0febdb37277d40df3866f50ac5da8ab29e20d6f73f67e1659a3d75538a9ed2

Observation e4afd30e-ab33-43c9-ae62-78fa93399540 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

LOST: Low-rank and Sparse Pre-training for Large Language Models LLaMA: Open and Efficient Foundation Language Models

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.106626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.106626Z digest=sha256:b4c00047021c9eff8048e1ace52fcb09b2f3669d643835d8aa3226dc54d95401

Observation 2ef5faf2-9f46-46db-99db-134e5c0a9e3c · outbound

This paper cites Root mean square layer normalization.

LOST: Low-rank and Sparse Pre-training for Large Language Models Root mean square layer normalization

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.111120Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.111120Z digest=sha256:34e7cd064f4ce954fdce3a604cb1d36ee314b48c5f38e64be54fb175f3f6b61c

Observation 77639cfb-d69d-46b3-84e2-9dc613567e3c · outbound

This paper cites GLU Variants Improve Transformer.

LOST: Low-rank and Sparse Pre-training for Large Language Models GLU Variants Improve Transformer

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.115079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.115079Z digest=sha256:1ca0d18e2b371c3e8e982c7bc9b998d0cac78e45eab141126ffeab56fa2e8caa

Observation 33b522a7-07d4-4747-a7c7-9b216e301268 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

LOST: Low-rank and Sparse Pre-training for Large Language Models RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.119536Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.119536Z digest=sha256:9af0b2cf6a48778a6a39ae64a02e2f8c8fd09eae30311a7b8257daee8f749d55

Observation 3ebfeae4-f2ae-4ba3-9e0e-936aef17e034 · outbound

This paper cites GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

LOST: Low-rank and Sparse Pre-training for Large Language Models GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-15T17:44:20.123934Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:44:20.123934Z digest=sha256:7a15827f07bc03edf2dd91779f33752f68b81fa04303c5644da357a85e0714cd

Pith citing papers

Observation 93b6c660-bcd1-4dda-9f8a-60a1ea3f25cc · inbound

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure cites this paper.

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 36

Resolution
verified exact
arxiv_id, observed 2026-05-18T14:52:41.334819Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-18T14:51:30.312509Z digest=sha256:980d0f02df528b9ae85e87f7d555829545b49aea60466802a05f04a12fe8f383

Observation f2a6803d-cf78-40f8-977a-7e89afb9b216 · inbound

BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models cites this paper.

BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-16T23:21:21.574771Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-16T23:19:02.358348Z digest=sha256:42491a4faf57b21b528b761669d77f464c3ff8402d566e6a73b004a09c890a72

Observation 14b5ae28-76fd-4843-9180-75a2e7fd78ab · inbound

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference cites this paper.

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-03T06:01:14.921682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T06:01:14.921682Z digest=sha256:9a0244d9acc242cf99699c8cea40ecf31e8037e81e3310eb0dd53a05c2148859

Observation 431d40f3-7e33-4534-9efe-08c4e1ff636f · inbound

Spectral Compact Training: Pre-Training Large Language Models via Permanent Truncated SVD and Stiefel QR Retraction cites this paper.

Spectral Compact Training: Pre-Training Large Language Models via Permanent Truncated SVD and Stiefel QR Retraction LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-13T22:58:24.130724Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=arxiv_source observed=2026-05-13T22:54:02.492105Z digest=sha256:2c4507d3aa4a5999c5303746efb5465ff761f318a82f4777f5d45d379357489d

Observation 88079b2f-06d7-49d5-9aec-0f4af1e9a2b1 · inbound

Low-Rank Adaptation Redux for Large Models cites this paper.

Low-Rank Adaptation Redux for Large Models LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 107

Resolution
verified exact
arxiv_id, observed 2026-05-11T14:26:03.945876Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-09T21:48:48.992712Z digest=sha256:4018e7ee5a215b5b46f872d421207690db8d4affb8fa87790c1a0e051f80cb5b

Observation 6c295afb-2937-4f93-acd1-776ca5c533dc · inbound

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training cites this paper.

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-14T19:19:23.495124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-14T19:19:18.275446Z digest=sha256:091bdd34d505c99574dd3c9b5e896ef8cd4b56826d2e5b73c9aa0c2a2975824a

Observation dc1cc48d-ca4d-44dd-a91f-e8baaed1dd73 · inbound

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training cites this paper.

Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-20T20:28:59.916751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-20T20:24:26.681383Z digest=sha256:d2449d6543bb0e7d4910e7dc0ef068ba9fc9d1e8392211b518cd2eebc29df458

Observation 730d5a5a-15dd-481e-9583-4151a9f46e6d · inbound

SLORR: Simple and Efficient In-Training Low-Rank Regularization cites this paper.

SLORR: Simple and Efficient In-Training Low-Rank Regularization LOST: Low-rank and Sparse Pre-training for Large Language Models

Reference 36

Resolution
verified exact
local_arxiv, observed 2026-07-10T02:06:42.159982Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-07-10T01:58:58.772489Z digest=sha256:4b59d977dbda569458095ceb406359a387b706fc56b1f0ca6e8ac1ab42f3a1ea