Pith. sign in

Paper Citation Record · LEDGER

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

As of 11 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2502.02794.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.02794 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T11:10:43.610161Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T13:57:58.048943Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T13:58:04.938613Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact1
  • verified fuzzy14
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a95d44f5-7178-4de5-9c9c-96599c7dbef3 · outbound

This paper cites Which documentation for software maintenance?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Which documentation for software maintenance?

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.181730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.464614Z digest=sha256:21b81a94d9afbe19a7d2f0175ef5bc48b70404e65c5ebce02481bd09d601ec13

Observation c5d631a4-1463-4383-aae8-6e075027861f · outbound

This paper cites Examining the evolution of code comments in postgresql,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Examining the evolution of code comments in postgresql,

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.470009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.470009Z digest=sha256:27dc81f0f9b8109b569687d24b64bb33db703ebefa787cb67e355146e419caaf

Observation aee5ead3-7451-4ebc-944c-b240d0aa0f7c · outbound

This paper cites /* icomment: Bugs or bad comments?*,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries /* icomment: Bugs or bad comments?*,

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.475145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.475145Z digest=sha256:61bb6668277f6701600401221766416881daba236372f7b2714093687a1cf29b

Observation f236a152-ca53-4458-9316-725fd3f902a2 · outbound

This paper cites acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.153152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.481096Z digest=sha256:f1bebf91278092a2cacb5d6daebd6815a2a3daff0ff7b6c97771e29dbbbc1cb4

Observation 1b34e786-8ad9-4264-9017-4b0fa48211b0 · outbound

This paper cites @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.134640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.486735Z digest=sha256:a6db65fd9d05616d32f8913025270310ff1f211d0c6505d0adb445fbd853399a

Observation 3c68c659-a07b-4080-a1f4-637c176c01d8 · outbound

This paper cites Detecting fragile comments,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting fragile comments,

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.118940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.493238Z digest=sha256:567e6049103a49db16b778c265ee281e137dcedbe25a219258399e82763cc287

Observation a2fdc91c-7305-4cb2-a5e8-00e8b7c3e43f · outbound

This paper cites Coherence of comments and method implementations: a dataset and an empirical investigation,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Coherence of comments and method implementations: a dataset and an empirical investigation,

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.081704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.498666Z digest=sha256:999b556a226e942776a89390a59886993bf0f4ee5634f7cce7d3b3cf685eaf5c

Observation d5481132-68db-4439-969e-287ebd414462 · outbound

This paper cites Deep just- in-time inconsistency detection between comments and source code,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Deep just- in-time inconsistency detection between comments and source code,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.046616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.503694Z digest=sha256:ae72d4aaf008ad989c59b5421b66346587e634a8884bb63cb66f98b71fdcc5eb

Observation da1e3060-4a36-4cc6-a117-eb5304e31e96 · outbound

This paper cites Detecting code comment inconsistency using siamese recurrent network,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting code comment inconsistency using siamese recurrent network,

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.027616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.508503Z digest=sha256:ff6d20643a20997b68d61857960c0495268e5b09223029c1b98ed31b4b9cc8af

Observation 059ce772-6a50-4829-95ad-282c8d2f4760 · outbound

This paper cites Competition- level code generation with alphacode,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Competition- level code generation with alphacode,

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.513244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.513244Z digest=sha256:e116d88e80e428d5cb23571640bff4e320179d7cfe75a1bbe181fb699f6e3b89

Observation 1a44dc72-3397-44ab-b4a6-74a0b62a93f9 · outbound

This paper cites Large language models are few- shot testers: Exploring llm-based general bug reproduction,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Large language models are few- shot testers: Exploring llm-based general bug reproduction,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.998615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.517937Z digest=sha256:3daae5fc9a7038dac65a99595bd5a9af64d181dcc3a23d33951bdc080fa621f1

Observation 435cf357-062f-443c-9ee5-664664da2f05 · outbound

This paper cites Adaptive test generation using a large language model,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Adaptive test generation using a large language model,

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.982546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.522577Z digest=sha256:1ad556ba86c2cd98da80b4ae8d42cf6c8d9849989ad3e1589908731d5a7a5a70

Observation 79fb9caf-1921-44d4-b202-ce05d4d5b320 · outbound

This paper cites Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

Reference 13

Resolution
verified exact
local_arxiv, observed 2026-08-09T11:10:58.800061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.527434Z digest=sha256:06e637a1f5e8505348f641ca73e74818dbf7375bbf514b77056ced9c908012b6

Observation 55d3102d-a38d-40cf-8a95-09f1bd0f9b61 · outbound

This paper cites A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.532852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.532852Z digest=sha256:e0cb3f391f3ef544c14a8d343211a787ac6985ab27590c2873c5f2d9aa816bd6

Observation 81cd43c4-0b04-4249-9825-3b4d5115912d · outbound

This paper cites Evosuite: automatic test suite generation for object-oriented software,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Evosuite: automatic test suite generation for object-oriented software,

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.537774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.537774Z digest=sha256:93fe6610de339cee2737f7545d21aa6d935a697dc754668ec6970aaae4934d3b

Observation 39318f00-ba44-4e13-b0b8-2aca65c3c5f7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.541890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.541890Z digest=sha256:c7cf847e84d42abff0e71e9ba14eb9806b3e91338420b8714089bb8e4fd91e5f

Observation 43cdf743-7104-410b-93e1-019d6b08761f · outbound

This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Self-Consistency Improves Chain of Thought Reasoning in Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.545907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.545907Z digest=sha256:bc04fd9e6b784f4d400998a46a3fae25782cbc42119e40f986af137438ff2f5f

Observation 3adf1e15-1e64-48c7-ba65-1877d6aa8e64 · outbound

This paper cites Defects4j: A database of existing faults to enable controlled testing studies for java programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Defects4j: A database of existing faults to enable controlled testing studies for java programs,

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.550426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.550426Z digest=sha256:c78728bbcc65462e9020f4f15f3ad89e712b97841ee97f1ee1f4b92c4d73c27c

Observation 1013b392-e1e4-4f85-a6f0-eba24472ffcb · outbound

This paper cites Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.554435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.554435Z digest=sha256:1f89aaf518f681a0be89c491d1bfeb62d0b980d0903a0ec8dd309825e187745c

Observation 606245b2-7cc3-46ba-aa4e-08686a6a01af · outbound

This paper cites Automatic Code Summarization via ChatGPT: How Far Are We?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Code Summarization via ChatGPT: How Far Are We?

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.559168Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.559168Z digest=sha256:3d4ef62838f61d88d0610ce42dc5a7b3af8026dc8336667b168177f62c1e28ff

Observation 70a7b020-4105-4003-82ee-7acabd93fedd · outbound

This paper cites Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization).

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.564400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.564400Z digest=sha256:b0c837ffd10e837f3da370a32929f50a5f487ccd64f9da1f8a45b4d409f04817

Observation ffb2425c-2516-4357-b0f2-8a63ae6cb195 · outbound

This paper cites GPT-4 Technical Report.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries GPT-4 Technical Report

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.569635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.569635Z digest=sha256:1bddfaa6c1f29ff949b74a80071205c79850bf01576398e56a507d4bb099f12b

Observation d0a217aa-5fd0-4739-95da-c5c2a7e5aa3d · outbound

This paper cites A survey on metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A survey on metamorphic testing,

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.574801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.574801Z digest=sha256:344eee723192c5d4684cf5838a216faf403b724f881144f60252b774064eb944

Observation 3738edaf-d2f8-426e-acc5-d1382d3390f4 · outbound

This paper cites Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.934388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.580910Z digest=sha256:a12705cb3770f843e00c4061b96a5a4eb1afd1dd675c5611655a0dff46664f59

Observation 5a1da619-48b1-47dc-a9a5-e1b2adf31d5b · outbound

This paper cites Properties of machine learning applications for use in metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Properties of machine learning applications for use in metamorphic testing,

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.919341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.587091Z digest=sha256:53e43fef9f42453d18fc63e54556ca40b2dbc41c26c94ba345d06472b17bb442

Observation cc21ea90-f070-4b5b-bfa9-a58bb64c91f2 · outbound

This paper cites Testing and validating machine learning classifiers by metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Testing and validating machine learning classifiers by metamorphic testing,

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.904406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.593140Z digest=sha256:5618596fe068a8e2d8ffc44f688098cf686652e834929e8cc9cef78dc23e785e

Observation 7826cce9-19bd-466b-92a5-115f6577d361 · outbound

This paper cites On Testing Non-Testable Programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries On Testing Non-Testable Programs,

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.888093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.598999Z digest=sha256:d5b71d1b30c1101172bae9ac038fc58b947b405cb83a09e967d279a247791e02

Observation f4c252ee-2ffe-4135-93cf-ccc0462356a7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.604514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.604514Z digest=sha256:45de9a6a60933fb91d8295c4b38a84aef68eb0e67f3f4c377569eac933d83bb7

Observation c38f9cd1-b8f7-4363-b24a-f8620f2cdfea · outbound

This paper cites Major: An efficient and extensible tool for mutation analysis in a java compiler,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Major: An efficient and extensible tool for mutation analysis in a java compiler,

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.860398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T11:10:43.610161Z digest=sha256:3f9fe598ed6fbc9d4b2738a12a1577a76582b982cad9c69c3e486cc3e6f0dc1f

Pith citing papers

Observation 21730c79-ffe6-4b9d-b0e2-0bd0c2514b4f · inbound

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments cites this paper.

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:58:05.029561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-05T13:57:58.048943Z digest=sha256:f85566e01a46dc711ce071a2b11e209d5ff54524323340674e9bcd2e2f8da1d5