Paper Citation Record · LEDGER

Model Merging in Pre-training of Large Language Models

As of 19 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 11 inbound Pith citation observations for arXiv:2505.12082.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.12082 v3

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T20:46:28.238597Z

measured 68 of 68 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T17:30:10.163726Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T10:49:46.245243Z

Reference resolution

57 of 57 outbound references displayed

verified exact0
verified fuzzy24
unresolved33
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation dc5cf18c-451a-4f70-9c22-712ccb546981 · outbound

This paper cites GPT-4 Technical Report.

Model Merging in Pre-training of Large Language Models GPT-4 Technical Report

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:27.985936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 113a2c22-078a-44da-9bb5-3ac6372e80b4 · outbound

This paper cites Evolutionary optimization of model merging recipes.

Model Merging in Pre-training of Large Language Models Evolutionary optimization of model merging recipes

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:27.991379Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a06fe965-8853-4ab4-9c45-54f33b7cc8c9 · outbound

This paper cites Program Synthesis with Large Language Models.

Model Merging in Pre-training of Large Language Models Program Synthesis with Large Language Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:27.996068Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5bcbde28-ffdc-4097-9834-52c36772cf39 · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Model Merging in Pre-training of Large Language Models DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.001379Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation abf61e49-c49b-4a58-970b-e6ea3f5c7287 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Model Merging in Pre-training of Large Language Models Evaluating Large Language Models Trained on Code

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.006262Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c91f5bf3-8d9e-48fc-94aa-93bffa4db82e · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

Model Merging in Pre-training of Large Language Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.011465Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1657b69-436f-4b9a-b7ab-d23823604a78 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

Model Merging in Pre-training of Large Language Models Training Verifiers to Solve Math Word Problems

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.016606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b8d5fa3a-2383-49ef-ae99-9e16c020f42b · outbound

This paper cites Gradient descent on neural networks typically occurs at the edge of stability.

Model Merging in Pre-training of Large Language Models Gradient descent on neural networks typically occurs at the edge of stability

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.021188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f6af6af-c17b-452e-9cb9-7cdb04977025 · outbound

This paper cites An image is worth 16x16 words: Transformers for image recognition at scale.

Model Merging in Pre-training of Large Language Models An image is worth 16x16 words: Transformers for image recognition at scale

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.025569Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 694e03df-c1b9-420e-9715-8601d83ca4e1 · outbound

This paper cites DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs.

Model Merging in Pre-training of Large Language Models DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:29.088974Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation afdfec0b-13eb-410b-90a2-86a92e6d70e3 · outbound

This paper cites The llama 3 herd of models.arXiv e-prints, pages arXiv–2407, 2024.

Model Merging in Pre-training of Large Language Models The llama 3 herd of models.arXiv e-prints, pages arXiv–2407, 2024

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.034400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d02f92f1-ae8a-4335-b87b-c16443f94f05 · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

Model Merging in Pre-training of Large Language Models DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.038785Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fdbbd56-4a27-4c7a-a7f2-d1535cbc2ff4 · outbound

This paper cites Scaling laws and compute-optimal training beyond fixed training durations.Advances in Neural Information Processing Systems, 37:76232–76264, 2024.

Model Merging in Pre-training of Large Language Models Scaling laws and compute-optimal training beyond fixed training durations.Advances in Neural Information Processing Systems, 37:76232–76264, 2024

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:29.065656Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 161b767d-48e6-4e61-939a-a37620cbbca0 · outbound

This paper cites Measuring massive multitask language understanding.

Model Merging in Pre-training of Large Language Models Measuring massive multitask language understanding

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.047542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7168105-42fe-4f7b-be6e-5506274842cf · outbound

This paper cites MiniCPM: Unveiling the potential of small language models with scalable training strategies.

Model Merging in Pre-training of Large Language Models MiniCPM: Unveiling the potential of small language models with scalable training strategies

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:29.042041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 4370adf0-5a6c-4cb9-937f-865e0524054d · outbound

This paper cites C-eval: A multi-level multi-discipline chinese evaluation suite for foundation models.

Model Merging in Pre-training of Large Language Models C-eval: A multi-level multi-discipline chinese evaluation suite for foundation models

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:29.027766Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation d96def94-1097-4ab3-90da-66a2037988e4 · outbound

This paper cites The exponentially weighted moving average.Journal of quality technology, 18(4):203–210, 1986.

Model Merging in Pre-training of Large Language Models The exponentially weighted moving average.Journal of quality technology, 18(4):203–210, 1986

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.060418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation caade15a-3dbd-4e92-934c-7eeadf223440 · outbound

This paper cites Editing models with task arithmetic.

Model Merging in Pre-training of Large Language Models Editing models with task arithmetic

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:29.003251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 15e89984-c6ad-4484-935f-64099d86899e · outbound

This paper cites Dataless knowledge fusion by merging weights of language models.

Model Merging in Pre-training of Large Language Models Dataless knowledge fusion by merging weights of language models

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.987743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 2429eb69-8451-44db-801b-b86f1afe2439 · outbound

This paper cites Some properties of a simple moving average when applied to forecasting a time series.Journal of the Operational Research Society, 50(12):1267–1271, 1999.

Model Merging in Pre-training of Large Language Models Some properties of a simple moving average when applied to forecasting a time series.Journal of the Operational Research Society, 50(12):1267–1271, 1999

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.973248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a7fe01eb-919e-48e0-a51d-2a8c413791fa · outbound

This paper cites PopulAtion Parameter Averaging (PAPA).

Model Merging in Pre-training of Large Language Models PopulAtion Parameter Averaging (PAPA)

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.077730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ac51e743-4037-4e1c-b1bf-25e121691780 · outbound

This paper cites TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension.

Model Merging in Pre-training of Large Language Models TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.959066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 2b0de40c-ddfa-430a-8e69-f771b2f930d0 · outbound

This paper cites Stop wasting my time! saving days of imagenet and BERT training with latest weight averaging.

Model Merging in Pre-training of Large Language Models Stop wasting my time! saving days of imagenet and BERT training with latest weight averaging

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.944286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 6e4a93c5-356a-4446-9a3a-9e46f31c46e4 · outbound

This paper cites Scaling Laws for Neural Language Models.

Model Merging in Pre-training of Large Language Models Scaling Laws for Neural Language Models

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.091049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e54e9882-bdcf-4eaa-9728-ef474e5c1122 · outbound

This paper cites Trainable weight averaging: Efficient training by optimizing historical solutions.

Model Merging in Pre-training of Large Language Models Trainable weight averaging: Efficient training by optimizing historical solutions

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.930075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 08235f68-b1ff-48d8-961b-a118c409527e · outbound

This paper cites DeepSeek-V3 Technical Report.

Model Merging in Pre-training of Large Language Models DeepSeek-V3 Technical Report

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.099762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ceb07be9-756a-4a49-a66e-d7565e759fcd · outbound

This paper cites Checkpoint Merging via Bayesian Optimization in LLM Pretraining.

Model Merging in Pre-training of Large Language Models Checkpoint Merging via Bayesian Optimization in LLM Pretraining

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.104948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3309126d-ca29-4e54-a4e6-7c4fee9cfeb0 · outbound

This paper cites SGDR: Stochastic gradient descent with warm restarts.

Model Merging in Pre-training of Large Language Models SGDR: Stochastic gradient descent with warm restarts

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.109336Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcf1b735-1106-4bb8-a3d5-e7a6358126f7 · outbound

This paper cites Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct.

Model Merging in Pre-training of Large Language Models Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.906903Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 13cb1706-2de0-43c7-a4af-c32ebba4822d · outbound

This paper cites Merging models with fisher-weighted averaging.Advances in Neural Information Processing Systems, 35:17703–17716, 2022.

Model Merging in Pre-training of Large Language Models Merging models with fisher-weighted averaging.Advances in Neural Information Processing Systems, 35:17703–17716, 2022

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.117878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcb3d693-7a59-41d3-937b-9a222a560c6c · outbound

This paper cites An Empirical Model of Large-Batch Training.

Model Merging in Pre-training of Large Language Models An Empirical Model of Large-Batch Training

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.122787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e0cfc1d1-ea07-4974-a2ab-daedd6058278 · outbound

This paper cites The weighted moving average technique.Wiley Encyclopedia of Operations Research and Management Science, 2010.

Model Merging in Pre-training of Large Language Models The weighted moving average technique.Wiley Encyclopedia of Operations Research and Management Science, 2010

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.883090Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 15e7104d-207f-4cdc-af77-ce5ef72d3731 · outbound

This paper cites Gpqa: A graduate-level google-proof q&a benchmark.

Model Merging in Pre-training of Large Language Models Gpqa: A graduate-level google-proof q&a benchmark

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.131557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6017fe27-3ec2-46c4-acce-6ac0f84d3535 · outbound

This paper cites Winogrande: An adversarial winograd schema challenge at scale.Communications of the ACM, 64(9):99–106, 2021.

Model Merging in Pre-training of Large Language Models Winogrande: An adversarial winograd schema challenge at scale.Communications of the ACM, 64(9):99–106, 2021

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.136077Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f733f241-f864-4aa3-b47b-e00bc7be65b6 · outbound

This paper cites Early weight averaging meets high learning rates for LLM pre-training.

Model Merging in Pre-training of Large Language Models Early weight averaging meets high learning rates for LLM pre-training

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.850780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation ab4f75e6-a192-43b5-982f-1f1bf5f31dd0 · outbound

This paper cites Seed-thinking-v1.

Model Merging in Pre-training of Large Language Models Seed-thinking-v1

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.145028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e384067-98dc-4227-a9bd-81e473be7b7e · outbound

This paper cites DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models.

Model Merging in Pre-training of Large Language Models DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.149485Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a370094-ffcc-4ee8-ae56-bd33208f8ad3 · outbound

This paper cites Outrageously large neural networks: The sparsely-gated mixture-of-experts layer.

Model Merging in Pre-training of Large Language Models Outrageously large neural networks: The sparsely-gated mixture-of-experts layer

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.154477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1205ee6d-ee6c-4766-bad1-f09d51b5f3ee · outbound

This paper cites Challenging BIG-bench tasks and whether chain-of- thought can solve them.

Model Merging in Pre-training of Large Language Models Challenging BIG-bench tasks and whether chain-of- thought can solve them

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.828274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 73f8b1d7-a9a4-479b-a23e-544e4c0951be · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

Model Merging in Pre-training of Large Language Models Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.163645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6c6fd893-5ccb-4866-8714-d9865e9d7e1a · outbound

This paper cites Mmlu-pro: A more robust and challenging multi-task language understanding benchmark.

Model Merging in Pre-training of Large Language Models Mmlu-pro: A more robust and challenging multi-task language understanding benchmark

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.814108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3f52f625-1ed8-4e1d-b7c6-b32076afabdb · outbound

This paper cites Dai, and Quoc V Le.

Model Merging in Pre-training of Large Language Models Dai, and Quoc V Le

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.800404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 8b17a5cd-4a8d-4f45-bece-510fea2ae4d2 · outbound

This paper cites Livebench: A challenging, contamination-limited LLM benchmark.

Model Merging in Pre-training of Large Language Models Livebench: A challenging, contamination-limited LLM benchmark

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.786598Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 5ed6c65a-7216-4061-91ea-c214d88deb82 · outbound

This paper cites Small-scale proxies for large-scale transformer training instabilities.

Model Merging in Pre-training of Large Language Models Small-scale proxies for large-scale transformer training instabilities

Reference 44

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.771728Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 07f1acda-f168-41bb-8595-4c7eb99b71b7 · outbound

This paper cites WizardLM: Empowering large pre-trained language models to follow complex instructions.

Model Merging in Pre-training of Large Language Models WizardLM: Empowering large pre-trained language models to follow complex instructions

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.756060Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3f9a73ed-d049-4584-b97b-64c716ee8d7e · outbound

This paper cites TIES-merging: Resolving interference when merging models.

Model Merging in Pre-training of Large Language Models TIES-merging: Resolving interference when merging models

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.739730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 975fafc3-1f35-4e9e-acd6-997afcb40bc5 · outbound

This paper cites Baichuan 2: Open Large-scale Language Models.

Model Merging in Pre-training of Large Language Models Baichuan 2: Open Large-scale Language Models

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.194200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1419f775-e006-4a89-8060-f18f0bf6a6ae · outbound

This paper cites Qwen2.5 Technical Report.

Model Merging in Pre-training of Large Language Models Qwen2.5 Technical Report

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.198793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20d6aab7-72a0-45d2-a645-5d0e0a4bd855 · outbound

This paper cites Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities.

Model Merging in Pre-training of Large Language Models Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.203139Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa8c7e5b-22e5-4888-959e-d68ffeec81a2 · outbound

This paper cites Adamerging: Adaptive model merging for multi-task learning.

Model Merging in Pre-training of Large Language Models Adamerging: Adaptive model merging for multi-task learning

Reference 50

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.725421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation bc2a334e-9ee0-4af7-82c9-269437af24c5 · outbound

This paper cites Language models are super mario: Absorbing abilities from homologous models as a free lunch.

Model Merging in Pre-training of Large Language Models Language models are super mario: Absorbing abilities from homologous models as a free lunch

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.711011Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3e4cb3b1-6dcc-4ef7-9ac8-a149d50e25fe · outbound

This paper cites DAPO: An Open-Source LLM Reinforcement Learning System at Scale.

Model Merging in Pre-training of Large Language Models DAPO: An Open-Source LLM Reinforcement Learning System at Scale

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.216068Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa64e4dd-c4bf-4bef-8fa8-94024c6853c2 · outbound

This paper cites VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Tasks.

Model Merging in Pre-training of Large Language Models VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Tasks

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.220562Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d7d8925-ac6d-4eca-9cb6-31086e773e10 · outbound

This paper cites HellaSwag: Can a Machine Really Finish Your Sentence?.

Model Merging in Pre-training of Large Language Models HellaSwag: Can a Machine Really Finish Your Sentence?

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.225152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e386bee-32b1-4cea-863e-91acaf16e72a · outbound

This paper cites Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problems.

Model Merging in Pre-training of Large Language Models Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problems

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-15T20:46:28.229714Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6694c25b-3f3b-41a3-bd03-50540bfc15eb · outbound

This paper cites AGIEval: A human-centric benchmark for evaluating foundation models.

Model Merging in Pre-training of Large Language Models AGIEval: A human-centric benchmark for evaluating foundation models

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.695843Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation bf9d46d5-0779-438b-aab2-fd7d94bc92b3 · outbound

This paper cites MetaGPT: Merging large language models using model exclusive task arithmetic.

Model Merging in Pre-training of Large Language Models MetaGPT: Merging large language models using model exclusive task arithmetic

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T20:46:28.681134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Pith citing papers

Observation 11f46116-417b-46e2-9a8f-da9c9ba887cd · inbound

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities cites this paper.

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities Model Merging in Pre-training of Large Language Models

Reference 129

Resolution: verified exact; arxiv_id, observed 2026-05-17T22:16:04.524049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 04dde608-7a4e-4db6-9a65-e5d8367a23ee · inbound

Kwai Keye-VL Technical Report cites this paper.

Kwai Keye-VL Technical Report Model Merging in Pre-training of Large Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T20:45:08.181516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b01d7e69-effd-4359-869c-aaa6507bee03 · inbound

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training cites this paper.

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training Model Merging in Pre-training of Large Language Models

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-06T14:49:40.270904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d532f56f-1d36-4e14-a307-9d752f503eed · inbound

ReaLM: Reflection-Enhanced Autonomous Reasoning with Small Language Models cites this paper.

ReaLM: Reflection-Enhanced Autonomous Reasoning with Small Language Models Model Merging in Pre-training of Large Language Models

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-15T17:30:10.163726Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7a559c1-04ee-4264-b5dd-27d1d9222cd3 · inbound

Waver: Wave Your Way to Lifelike Video Generation cites this paper.

Waver: Wave Your Way to Lifelike Video Generation Model Merging in Pre-training of Large Language Models

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-05T17:45:16.870761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cdfded52-de3c-4810-8fbc-99db82938247 · inbound

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models cites this paper.

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models Model Merging in Pre-training of Large Language Models

Reference 21

Resolution: verified exact; arxiv_id, observed 2026-05-20T12:23:16.787163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e7bd2b19-81d5-452c-b607-0ede6828ea68 · inbound

Anytime Training with Schedule-Free Spectral Optimization cites this paper.

Anytime Training with Schedule-Free Spectral Optimization Model Merging in Pre-training of Large Language Models

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-25T05:40:24.455637Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 6cac034e-95b0-4736-a464-d13520d85f90 · inbound

Kwai Keye-VL-2.0 Technical Report cites this paper.

Kwai Keye-VL-2.0 Technical Report Model Merging in Pre-training of Large Language Models

Reference 89

Resolution: verified exact; arxiv_id, observed 2026-07-03T04:27:37.028942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a161417f-12aa-443a-9431-55420b5ce9fc · inbound

Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI cites this paper.

Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI Model Merging in Pre-training of Large Language Models

Reference 65

Resolution: verified exact; arxiv_id, observed 2026-07-04T10:49:46.246632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 556c49c3-1768-4df0-bda2-1621d33479bb · inbound

LLM Evolution as an Industry-Scale Ecosystem: A Lifecycle Perspective on Continual Learning cites this paper.

LLM Evolution as an Industry-Scale Ecosystem: A Lifecycle Perspective on Continual Learning Model Merging in Pre-training of Large Language Models

Reference 59

Resolution: verified exact; arxiv_id, observed 2026-07-03T16:48:39.896841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 8a40e590-512f-447e-9ff7-8ec128222178 · inbound

Optimizing Visual Generative Models via Distribution-wise Rewards cites this paper.

Optimizing Visual Generative Models via Distribution-wise Rewards Model Merging in Pre-training of Large Language Models

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-07-03T16:48:39.787654Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.