Paper Citation Record · LEDGER

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

As of 10 August 2026, this Paper Citation Record lists 17 of 17 outbound references and 15 inbound Pith citation observations for arXiv:2507.07451.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07451 v1

Coverage vector

measured 17 of 17 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:47:53.026897Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 15 of 15 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T08:15:59.069553Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T07:59:40.165966Z

Reference resolution

17 of 17 outbound references displayed

verified exact0
verified fuzzy1
unresolved16
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b088bdc2-b2a5-4392-a83f-8feaf9ade318 · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-06T18:47:53.580139Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 73a3f962-c41a-4bd2-91c6-7e2c8e929205 · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.863138Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e44144e7-bbef-4dc3-abaf-78aa41bf1c3f · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-06T18:47:53.565275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b559eaa4-2bff-45fc-9c63-92603b92741b · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.967896Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52e57824-a06d-481f-b04a-5e8790af495b · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.972497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 474fbb0d-2761-4a12-a0ba-c3bdcad7ada2 · outbound

This paper cites Understanding R1-Zero-Like Training: A Critical Perspective.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Understanding R1-Zero-Like Training: A Critical Perspective

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.976774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9507fb39-46cf-407e-afec-818af53a1e7e · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T18:47:53.550737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 9477c727-1f68-498f-820c-9995f14a3279 · outbound

This paper cites Openai o1 system card.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Openai o1 system card

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:47:53.534839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4ae26289-3377-4e46-8f47-369694799228 · outbound

This paper cites Prioritized Experience Replay.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Prioritized Experience Replay

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.990150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73bca3c6-127e-4ed5-8307-793c812424b6 · outbound

This paper cites DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.994487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 953f5c33-f686-48ba-b15d-14589505cdf6 · outbound

This paper cites HybridFlow: A Flexible and Efficient RLHF Framework.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning HybridFlow: A Flexible and Efficient RLHF Framework

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:52.998807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89149ea1-74f9-4a6e-b5a6-fc3827d7b7b3 · outbound

This paper cites an unresolved cited work.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.003183Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70b477f0-1efe-40e1-acb5-a0f6cbcc92b2 · outbound

This paper cites Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.007802Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d01f2037-0923-4a59-94f8-19a5ee13f10d · outbound

This paper cites Learning to Reason under Off-Policy Guidance.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Learning to Reason under Off-Policy Guidance

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.012363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1c3d17e-85a6-4121-b93c-b096f2e75002 · outbound

This paper cites Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.017126Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 99272396-9262-43cf-b742-4022c013c4f1 · outbound

This paper cites Qwen3 Technical Report.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning Qwen3 Technical Report

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.022014Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 753b1d4b-3e9c-4d5f-b4c2-96ad20b0e56f · outbound

This paper cites DAPO: An Open-Source LLM Reinforcement Learning System at Scale.

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning DAPO: An Open-Source LLM Reinforcement Learning System at Scale

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T18:47:53.026897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation dac9cfc3-8c42-440f-ae91-ff827c37b32c · inbound

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models cites this paper.

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 112

Resolution: unresolved; no resolver link, observed 2026-08-04T08:15:59.069553Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d7f21a67-f54a-4b20-ac92-4d3c06536a5d · inbound

EasyVideoR1: Easier RL for Video Understanding cites this paper.

EasyVideoR1: Easier RL for Video Understanding RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 51

Resolution: verified exact; arxiv_id, observed 2026-05-10T07:42:06.748293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2092eeef-c21b-4e07-9145-e23e6f9a9eaa · inbound

Near-Future Policy Optimization cites this paper.

Near-Future Policy Optimization RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-10T00:54:48.603133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a8b9d20c-620a-4815-9db1-9c01ea163064 · inbound

Rethinking Importance Sampling in LLM Policy Optimization: A Cumulative Token Perspective cites this paper.

Rethinking Importance Sampling in LLM Policy Optimization: A Cumulative Token Perspective RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-11T04:30:55.227343Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ac6c1eb1-842d-4db9-8521-9f10ca992b96 · inbound

Trust Region On-Policy Distillation cites this paper.

Trust Region On-Policy Distillation RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 275

Resolution: verified exact; arxiv_id, observed 2026-07-01T20:56:13.655426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c4d71b5c-3edd-49e8-8ea1-e94e8cbd8310 · inbound

RLVR without Ineffective Samples: Group Prioritized Off-Policy Optimization for LLM Reasoning cites this paper.

RLVR without Ineffective Samples: Group Prioritized Off-Policy Optimization for LLM Reasoning RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 64

Resolution: verified exact; arxiv_id, observed 2026-07-01T21:16:13.343127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7e06d7af-d662-47fa-95f4-a09215f3a59b · inbound

Learning to Solve, Forgetting to Retain: Correct-Set Turnover in RLVR cites this paper.

Learning to Solve, Forgetting to Retain: Correct-Set Turnover in RLVR RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 143

Resolution: verified exact; arxiv_id, observed 2026-07-02T01:36:25.002327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ddd15fc1-9f0d-44a3-8ea3-1575dfdde3e1 · inbound

Rollout-Level Advantage-Prioritized Experience Replay for GRPO cites this paper.

Rollout-Level Advantage-Prioritized Experience Replay for GRPO RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 76

Resolution: verified exact; arxiv_id, observed 2026-07-02T06:06:41.007463Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ceee3d62-14e9-492e-b822-b47524bb934e · inbound

Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients cites this paper.

Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 48

Resolution: verified exact; arxiv_id, observed 2026-07-03T20:48:56.024146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 08963af0-1e52-4b44-8a39-67a91b27948b · inbound

Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning cites this paper.

Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 261

Resolution: verified exact; arxiv_id, observed 2026-07-04T07:59:40.167556Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation cd42a4e4-5c79-42c5-b36b-22bfd527b87d · inbound

DRIFT: Difficulty Routing Self-DIstillation with Rhythm-Gated Exploration and Success BuFfer Training cites this paper.

DRIFT: Difficulty Routing Self-DIstillation with Rhythm-Gated Exploration and Success BuFfer Training RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 22

Resolution: metadata mismatch; arxiv_id, observed 2026-06-30T07:24:21.451888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6e9c4b3e-42fc-4ebd-b38b-3d63fb707d2e · inbound

Experience Augmented Policy Optimization for LLM Reasoning cites this paper.

Experience Augmented Policy Optimization for LLM Reasoning RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-06-30T06:54:20.299729Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e9e37322-2c65-4c7c-9231-098e61e842ed · inbound

Experience Augmented Policy Optimization for LLM Reasoning cites this paper.

Experience Augmented Policy Optimization for LLM Reasoning RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T09:32:16.230452Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 501b1519-0b51-4cc8-9d05-ace24da922c5 · inbound

ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples cites this paper.

ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 52

Resolution: unresolved; no resolver link, observed 2026-07-14T11:23:30.063231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e769e426-7214-4d05-bd84-4105242bdd2e · inbound

ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples cites this paper.

ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-02T07:23:29.013207Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.