Pith. sign in

Paper Citation Record · LEDGER

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

As of 10 August 2026, this Paper Citation Record lists 19 of 19 outbound references and 6 inbound Pith citation observations for arXiv:2502.00595.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.00595 v1

Coverage vector

measured 19 of 19 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T18:32:00.914034Z

measured 25 of 25 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 6 of 6 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:52:41.807437Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

19 of 19 outbound references displayed

  • verified exact0
  • verified fuzzy5
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation c187ca5e-09a1-4e1a-ab21-f5b0d0f3a6e1 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.137300Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.850647Z digest=sha256:4b778a7acb3dbd18cc7d0417c0b9f1e2c238fec9edc4043c7aa0249ed7f9fdc3

Observation 356284b6-89c7-494a-b6ff-7b1dd61c2e65 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.127109Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.854357Z digest=sha256:618eeacbe2255be44c9d404eaaa99e8967d5cc47b875bcb0a8cdef203e9212ee

Observation e37b7299-0ecd-4114-b52c-7b8f4a59394d · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.117218Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.857972Z digest=sha256:300711ddba14075b64b785d59e3f7dc6d03a4e34b416b42c3d4e6619982beabf

Observation 4f316833-b2fd-4a45-b60d-6b38a1049c91 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.107119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.861985Z digest=sha256:e68bf6eba0312172bbc04441accbeab06a651d1150177351b37a75c4e20b2c51

Observation 7fe170ab-e19e-43fd-9bbf-5060bb371417 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.097586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.865863Z digest=sha256:430ec7d84cd439e13b5633b51d1cc7075e0ee0764403d74538723590c2f6db7f

Observation 8dadd6cd-1992-4b80-b84b-d809ee5e86b7 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.087742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.869712Z digest=sha256:870812fbd6d806f154b73fc7daa0fa29a8aa7be469ad6ac85e44cfa691693521

Observation 93c908d3-0773-4a57-90a6-89ff52538387 · outbound

This paper cites Although state_variables and hidden_variables are separate fields in the JSON schema, they collectively represent the State Variables described in the main text.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Although state_variables and hidden_variables are separate fields in the JSON schema, they collectively represent the State Variables described in the main text

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T18:32:01.076531Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.873613Z digest=sha256:441aad29109f9159e660317b20c3f86c90c4433ca6fc276c9de7ee4e71c02074

Observation 7f3f54fe-128a-4f39-b4f9-72f9eb285c7f · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.066016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.877182Z digest=sha256:2b8973a3935f3c3831666171a99010f48761430abfab2bdd3cd4c757fc41acdc

Observation 5b084490-4a25-4f4f-acdb-80795690322b · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.055361Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.881062Z digest=sha256:a1992c9fcdcd160108aaf9b8f06f427da354343300db94a3a6799383e146ea3c

Observation 8c906209-0d3d-4f21-8c4c-005f523c7d6a · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.044578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.884490Z digest=sha256:a7b32a9f678eb6009b9ecdf354b22ad034d6be1367ee0d1625d8213b7b12e49f

Observation e3983f77-cf5b-4509-b8e2-939d9d1e603b · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.033753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.888272Z digest=sha256:457188ac759e0052027396983ae608495a1f764708996febd42c68d779a5cd64

Observation 89ecb6fd-9a8a-4efc-962e-7a9b972ae6d2 · outbound

This paper cites title":.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines title":

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T18:32:01.022496Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.892045Z digest=sha256:ad11d2cec9ba6cb45a60a93148b53c075344354739818636e4827e0f41ff30d3

Observation 60a2d053-2d58-4713-9154-09ea6945f3bf · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:01.010819Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.896340Z digest=sha256:413350046eb3c84d7099d91d9b38a8ff762eb77a8d6770bbb286cb74f0451317

Observation d2c81558-381c-49c2-92bb-1a7c54b77d54 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:00.998790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.899980Z digest=sha256:9d8ca5499a5d77d1d406a985c9ace5ee33f2477abba11595ad7c2df8aabb469d

Observation 96bf992a-7170-4a57-ab2e-ebe9b79df26c · outbound

This paper cites While automatic evaluations show a clear gap between PER and PERd, human annotations exhibit a similar pattern but with greater variability.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines While automatic evaluations show a clear gap between PER and PERd, human annotations exhibit a similar pattern but with greater variability

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T18:32:00.988502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.903512Z digest=sha256:585b9ec6196f58c6cdc63fc9ed3a7e928119862f0ad578bc5950293b1635ff34

Observation 7a4be20f-4996-4b50-9de5-423d8d61f103 · outbound

This paper cites Table 9 shows that the Pearson correlation between PER Auto and PER Human is negative (-0.691), with Kendall correlation also negative (-0.429).

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Table 9 shows that the Pearson correlation between PER Auto and PER Human is negative (-0.691), with Kendall correlation also negative (-0.429)

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T18:32:00.978138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.907081Z digest=sha256:20a3bca032d911a4c27619c64da42419c5c6ce470f5a14e548968af7ff80d0f4

Observation 91f0f186-dd74-42da-ac86-dd623db53e02 · outbound

This paper cites While inter-human correlation for PER is negative (-0.310 Pearson, -0.286 Kendall), PERd exhibits a stronger but still weak agreement (0.649 Pearson).

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines While inter-human correlation for PER is negative (-0.310 Pearson, -0.286 Kendall), PERd exhibits a stronger but still weak agreement (0.649 Pearson)

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T18:32:00.967260Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.910712Z digest=sha256:364ecbba7da86afc2eead0329941c33b01e948c548aefc6632fca672a621dab3

Observation 4dec05f1-b965-4ce9-90e4-b6315153fc17 · outbound

This paper cites an unresolved cited work.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-09T18:32:00.955009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T18:32:00.914034Z digest=sha256:b6e1cca53a8f7d01221d44adc4bd2e7a172d86bcf85af44cc60ad24b60ad7a30

Observation 6e449ca6-95e6-4044-a050-9072578bb1eb · outbound

This paper cites MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents.

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents

Reference 125

Resolution
unresolved
no resolver link, observed 2026-08-09T18:32:00.845011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T18:32:00.845011Z digest=sha256:88ff5039dd8cc4cf6dd93a306f291f91bfc6da0fc41cd92d352c6ee22e154dcb

Pith citing papers

Observation de55d274-6c0b-4198-a6ce-f6c3a24a1221 · inbound

State-Inference-Based Prompting for Natural Language Trading with Game NPCs cites this paper.

State-Inference-Based Prompting for Natural Language Trading with Game NPCs RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T18:52:41.807437Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:52:41.807437Z digest=sha256:4c4bd4f0211eaec14659561b6f9ba0eb073e89b64626b566a0db6e90ca83bd3b

Observation 933488b7-8d2c-4ff2-a131-85f2abea48fd · inbound

What to Ask Next? Probing the Imaginative Reasoning of LLMs with TurtleSoup Puzzles cites this paper.

What to Ask Next? Probing the Imaginative Reasoning of LLMs with TurtleSoup Puzzles RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-05T20:29:46.923225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T20:29:46.923225Z digest=sha256:3be17b03d0a2815cb5ca1db7526963173e9cd031b30d32bfde7d5c93c5261b73

Observation e066b307-a80d-4b99-86e1-7a1f65ca1da6 · inbound

Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models cites this paper.

Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-05-17T23:20:27.826371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-17T23:16:56.957905Z digest=sha256:5532c5b4a7b8d7fe4a89db6581236ecb7dcc367a614f593c11017dee191ca2bf

Observation cf767c2a-72ad-4ac7-a4c4-f7d96863d053 · inbound

Mastering PokeGym: Graph-Guided Multimodal Evolution at Test Time cites this paper.

Mastering PokeGym: Graph-Guided Multimodal Evolution at Test Time RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 87

Resolution
verified exact
arxiv_id, observed 2026-05-11T05:41:00.464313Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-10T17:59:48.877783Z digest=sha256:d6f684433ed07850cd1778e887e1bf0cc91f5fe7e7db34906aad44b0ab9013d8

Observation ec3318d0-b102-4c8e-bc68-15ee2937957b · inbound

Mastering PokeGym: Graph-Guided Multimodal Evolution at Test Time cites this paper.

Mastering PokeGym: Graph-Guided Multimodal Evolution at Test Time RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 87

Resolution
unresolved
no resolver link, observed 2026-08-04T05:32:20.475850Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T05:32:20.475850Z digest=sha256:70b9854434d44141a02d69932e45c9dbda60d5b666b8ba8f36a8edcc0add0182

Observation 9fbbc597-9547-47fe-bf09-68838c9c027f · inbound

BOOKMARKS: Efficient Active Storyline Memory for Role-playing cites this paper.

BOOKMARKS: Efficient Active Storyline Memory for Role-playing RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-15T04:55:02.439088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-15T04:51:44.394368Z digest=sha256:d4c2c539ca39a5a5b7a25d23fd448952cfb56333a13070d9a33180576fd68a67