Paper Citation Record · LEDGER

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment

As of 23 August 2026, this Paper Citation Record lists 35 of 35 outbound references and 1 inbound Pith citation observation for arXiv:2411.11681.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.11681 v3

Coverage vector

measured 35 of 35 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T18:20:14.079797Z

measured 36 of 36 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T21:06:21.444253Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-15T21:06:22.177325Z

Reference resolution

35 of 35 outbound references displayed

verified exact0
verified fuzzy4
unresolved31
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 4064787b-f7f6-443e-8f16-7f71e4de827f · outbound

This paper cites G.; Guo, Z.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment G.; Guo, Z

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T18:20:14.762028Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation aa7c7899-4785-4ec0-a6aa-cfd9ab8ec6e0 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.743311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation f80b4755-1396-47f1-9daa-b465b198ac61 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.869596Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06e1e333-0396-420c-ae1e-1cf16f1ec4c3 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Training Verifiers to Solve Math Word Problems

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.876021Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0454d7f-5243-4c11-bf9b-2248ba093ae7 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.883203Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8043d3c7-1bee-4bd9-afa5-387d339eff64 · outbound

This paper cites The Llama 3 Herd of Models.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment The Llama 3 Herd of Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.890056Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eaccdb49-ae77-4a11-a633-333202d96141 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.699714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 9497a753-89b6-4f82-9ce7-188687de12d1 · outbound

This paper cites J.; Shen, Y.; Wallis, P.; Allen - Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; and Chen, W.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment J.; Shen, Y.; Wallis, P.; Allen - Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; and Chen, W

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.902327Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f71042d-a3e2-432a-9b13-8d46bdd26366 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.666411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 1ac934fb-3d04-40f6-91a5-53573afec9ee · outbound

This paper cites The Impact of Reasoning Step Length on Large Language Models.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment The Impact of Reasoning Step Length on Large Language Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.912332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17919b9b-4c53-43bc-83b3-d6b809a27bc3 · outbound

This paper cites Large Language Models are Zero-Shot Reasoners.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Large Language Models are Zero-Shot Reasoners

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.918672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf05dcc1-26d7-43c1-8876-d01f3cb28f33 · outbound

This paper cites Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.925085Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c4802d0c-712b-4a43-b151-360f2d971be9 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.648304Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 80bd7a93-1d16-4484-a643-d5174506a6a4 · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.626816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 288e386e-b59c-470a-8802-5dd726898d8c · outbound

This paper cites Let's Verify Step by Step.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Let's Verify Step by Step

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.943239Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3637dcc3-b26e-4069-b076-782c3ec85f84 · outbound

This paper cites WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.949599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 935a371f-ddf4-4ee1-b8bc-22d547689031 · outbound

This paper cites Let's reward step by step: Step-Level reward model as the Navigators for Reasoning.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Let's reward step by step: Step-Level reward model as the Navigators for Reasoning

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.956530Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69447051-366a-465c-8477-f75bb9e5cf60 · outbound

This paper cites L.; Bari, M.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment L.; Bari, M

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T18:20:14.605398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 0c50e244-fe21-46ca-8f14-cea0f08fe4e8 · outbound

This paper cites L.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; Schulman, J.; Hilton, J.; Kelton, F.; Miller, L.; Simens, M.; Askell, A.; Welinder, P.; Christiano, P.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment L.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; Schulman, J.; Hilton, J.; Kelton, F.; Miller, L.; Simens, M.; Askell, A.; Welinder, P.; Christiano, P

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.971334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a045a4e-846e-477d-a9fe-30b6ebb88054 · outbound

This paper cites D.; Ermon, S.; and Finn, C.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment D.; Ermon, S.; and Finn, C

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.978109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23db6937-3951-40e4-9360-c451fe2ac361 · outbound

This paper cites Proximal Policy Optimization Algorithms.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Proximal Policy Optimization Algorithms

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.984199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9da5c1f5-4f36-48fc-b445-30169a388486 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:13.990185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69932421-385d-4f3a-9afc-315608672f4b · outbound

This paper cites Solving math word problems with process- and outcome-based feedback.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Solving math word problems with process- and outcome-based feedback

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.001444Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ac11809-c912-46ac-a4e3-d6e3c29ad4a2 · outbound

This paper cites Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.014172Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a8d09c2-9393-499f-af82-283e414df92d · outbound

This paper cites V.; Chi, E.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment V.; Chi, E

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T18:20:14.560218Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation d195a577-dc7f-4dc9-bf04-853b4077e306 · outbound

This paper cites Aligning Large Language Models with Human: A Survey.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Aligning Large Language Models with Human: A Survey

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.025705Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7a366ea-27b8-4c33-909a-2a9edaa7432d · outbound

This paper cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.032820Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 573e6d72-f60c-4d78-8631-f0b8bf4e563e · outbound

This paper cites H.; Le, Q.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment H.; Le, Q

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T18:20:14.542206Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 79d8f286-c094-44d7-87c7-74217c82891a · outbound

This paper cites Qwen2 Technical Report.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Qwen2 Technical Report

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.043754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df8da85d-3057-4c60-847e-8f10c225b51b · outbound

This paper cites an unresolved cited work.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-12T18:20:14.520712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation ec768db9-f861-464d-ae29-35ae60d00303 · outbound

This paper cites ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.055687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e065f485-159f-40ea-b431-68dd1d3c3f96 · outbound

This paper cites ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.061179Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 948fde31-2f2d-4ef5-8106-19293324a369 · outbound

This paper cites DPO Meets PPO: Reinforced Token Optimization for RLHF.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment DPO Meets PPO: Reinforced Token Optimization for RLHF

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.066939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e0b9875-2783-407a-a813-3cbad5e146a6 · outbound

This paper cites , " * write output.state after.block = add.period write newline.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment , " * write output.state after.block = add.period write newline

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.073328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de6d25ca-9a10-465f-b98d-d47e637beaef · outbound

This paper cites write newline.

PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment write newline

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-12T18:20:14.079797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 625b7171-e13e-4332-9566-8c078399fdcb · inbound

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization cites this paper.

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization PSPO*: An Effective Process-supervised Policy Optimization for Reasoning Alignment

Reference 38

Resolution: verified exact; local_arxiv, observed 2026-08-15T21:06:22.181532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.