Paper Citation Record · LEDGER

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns

As of 10 August 2026, this Paper Citation Record lists 23 of 23 outbound references and 2 inbound Pith citation observations for arXiv:2505.23474.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.23474 v1

Coverage vector

measured 23 of 23 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:50:10.807992Z

measured 25 of 25 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T00:59:52.207597Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T16:41:18.221645Z

Reference resolution

23 of 23 outbound references displayed

verified exact0
verified fuzzy11
unresolved11
parse uncertain1
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 65c4786c-3b68-4fcd-93af-1cd184a00d94 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 1

Resolution: parse uncertain; raw_fallback, observed 2026-08-07T12:50:14.441363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 69966aaf-3219-46e1-a51c-fe9d40112df8 · outbound

This paper cites InThe Twelfth Inter- national Conference on Learning Representations.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns InThe Twelfth Inter- national Conference on Learning Representations

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:14.715022Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation debae775-08c2-4cf3-beb7-7ec6fb39f339 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:13.777412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3ab783d7-8ef5-404c-b362-a4a8a47622e4 · outbound

This paper cites InProceed- ings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Pa- pers), pages 9426–9439, Bangkok, Thailand.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns InProceed- ings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Pa- pers), pages 9426–9439, Bangkok, Thailand

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:14.583605Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 40c3ce94-a84a-4b61-b594-446c0c70629a · outbound

This paper cites Indexing starts at 1.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Indexing starts at 1

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:13.380097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4021477b-1333-456b-969e-a4b42a36b545 · outbound

This paper cites Supervising the search process produces reliable and generalizable information-seeking agents.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Supervising the search process produces reliable and generalizable information-seeking agents

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T12:50:09.106021Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2dd1eb7-acc9-4c0d-be80-e9297b2e4da9 · outbound

This paper cites ### Notes:.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns ### Notes:

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:12.886392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5d91dc26-6331-47d3-b241-82ab93cae470 · outbound

This paper cites original_question.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns original_question

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:14.296585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation fa47e5fb-34b6-48e1-9ea1-339532d70720 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:14.132812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 9b4971a8-4438-4f62-80c0-df8393b6f0f0 · outbound

This paper cites If the problem remains the same, you can copy the original question.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns If the problem remains the same, you can copy the original question

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:13.923988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation db53a570-1a83-4e36-afeb-2ab1bb21f970 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:13.576094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7ba3fccf-f189-47fe-8cc1-a6e5884bb620 · outbound

This paper cites These should also be part of modified_steps.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns These should also be part of modified_steps

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:13.141065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation fb9f2da4-eca7-4701-aa85-7f98c5f728fe · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:12.607611Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 88be8039-4ba9-422a-807a-7abc4368aff3 · outbound

This paper cites Do not use Unicode symbols such as \u2248 or \u00f7.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Do not use Unicode symbols such as \u2248 or \u00f7

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:12.360478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5b8eea3e-5576-4fe4-a2c4-5bb24622ca76 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:12.206434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation dfdea850-752d-41fc-8d2e-6992c5e8bf79 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:12.017457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b355d66d-5299-44d4-a3ec-1ae37e4dc346 · outbound

This paper cites But if the question is modified, ensure that the steps is judged based on the modified question.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns But if the question is modified, ensure that the steps is judged based on the modified question

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:11.807734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 63bd17e5-7734-46dc-b130-c3c741a84bf0 · outbound

This paper cites Table 9: Output format prompt for test case construction.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Table 9: Output format prompt for test case construction

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:11.553098Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f0927acf-098b-43f5-b738-346817278076 · outbound

This paper cites an unresolved cited work.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-07T12:50:11.337673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c6cec271-4979-4794-9cbc-1044141aebf3 · outbound

This paper cites Please put your final answer (Yes or No) in \boxed {}.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Please put your final answer (Yes or No) in \boxed {}

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T12:50:11.123360Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c90f73b7-2efe-4de7-9eb4-8952e2acb6f0 · outbound

This paper cites Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-07T12:50:09.019196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61de2095-0d17-444c-88a6-01b3badfa06f · outbound

This paper cites Critique-out-Loud Reward Models.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Critique-out-Loud Reward Models

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-07T12:50:08.718847Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fa02318-d3cb-4b80-bb73-a0c1e8dac829 · outbound

This paper cites Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute.

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-07T12:50:08.867038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 81dc8df2-5b22-4612-b7e8-22b815cfec68 · inbound

GM-PRM: A Generative Multimodal Process Reward Model for Multimodal Mathematical Reasoning cites this paper.

GM-PRM: A Generative Multimodal Process Reward Model for Multimodal Mathematical Reasoning Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T00:59:52.207597Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e9f884f-1360-4c01-b5e3-68594264d8f2 · inbound

GR-Ben: A General Reasoning Benchmark for Evaluating Process Reward Models cites this paper.

GR-Ben: A General Reasoning Benchmark for Evaluating Process Reward Models Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-05-11T16:41:18.225765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.