Pith. sign in

Paper Citation Record · LEDGER

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

As of 10 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2502.02794.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.02794 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T11:10:43.610161Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T13:57:58.048943Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T13:58:04.938613Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact1
  • verified fuzzy14
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a95d44f5-7178-4de5-9c9c-96599c7dbef3 · outbound

This paper cites Which documentation for software maintenance?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Which documentation for software maintenance?

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.181730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.464614Z digest=sha256:c7966536c184b7946ea7b2ea4694e210dcf3eac2d8576c73e3f32934d7ef1a50

Observation c5d631a4-1463-4383-aae8-6e075027861f · outbound

This paper cites Examining the evolution of code comments in postgresql,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Examining the evolution of code comments in postgresql,

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.470009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.470009Z digest=sha256:8efcf46d673a1d6bfec948c229441c50958c7f02bc1c636be941e8bab86fcca7

Observation aee5ead3-7451-4ebc-944c-b240d0aa0f7c · outbound

This paper cites /* icomment: Bugs or bad comments?*,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries /* icomment: Bugs or bad comments?*,

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.475145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.475145Z digest=sha256:b7e43adecf13197d7159b50983065b2a3a6cee48acbcdd197ae40b6b5f34d4a2

Observation f236a152-ca53-4458-9316-725fd3f902a2 · outbound

This paper cites acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.153152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.481096Z digest=sha256:919e4a0984e8cafd5aad3aa6e61d44a2fd0059510a2ae8494dffb2d02f76919c

Observation 1b34e786-8ad9-4264-9017-4b0fa48211b0 · outbound

This paper cites @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.134640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.486735Z digest=sha256:311498e0b63242405ac68b3e4a991782db7b9983df493f9ac0a304c4862b9298

Observation 3c68c659-a07b-4080-a1f4-637c176c01d8 · outbound

This paper cites Detecting fragile comments,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting fragile comments,

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.118940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.493238Z digest=sha256:9ac123d1d141d5e1c1fa58f7e7aee37e65349913273c22ed7a2aa44a4a18f9a4

Observation a2fdc91c-7305-4cb2-a5e8-00e8b7c3e43f · outbound

This paper cites Coherence of comments and method implementations: a dataset and an empirical investigation,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Coherence of comments and method implementations: a dataset and an empirical investigation,

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.081704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.498666Z digest=sha256:ae4bd9958098179a59115ab58f1ebc3d80b108abeeeab944c86307cee8b7df28

Observation d5481132-68db-4439-969e-287ebd414462 · outbound

This paper cites Deep just- in-time inconsistency detection between comments and source code,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Deep just- in-time inconsistency detection between comments and source code,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.046616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.503694Z digest=sha256:9c1c764d406dbeb37aa45c43c21bf1c0daaec82bfc4c0576a70cc0532f1285d3

Observation da1e3060-4a36-4cc6-a117-eb5304e31e96 · outbound

This paper cites Detecting code comment inconsistency using siamese recurrent network,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting code comment inconsistency using siamese recurrent network,

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.027616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.508503Z digest=sha256:5157356f8c811563f2ecc079f9887eb2ccd824aaabdd572f37bf25060e65b780

Observation 059ce772-6a50-4829-95ad-282c8d2f4760 · outbound

This paper cites Competition- level code generation with alphacode,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Competition- level code generation with alphacode,

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.513244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.513244Z digest=sha256:4f31cc0ce54c6016788d23dad4ddd24356cbfb02192b74b2b809bd8513894423

Observation 1a44dc72-3397-44ab-b4a6-74a0b62a93f9 · outbound

This paper cites Large language models are few- shot testers: Exploring llm-based general bug reproduction,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Large language models are few- shot testers: Exploring llm-based general bug reproduction,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.998615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.517937Z digest=sha256:6a147eaa5306bffc862e16e0b3f6a291a138b1fd104344c0e5d8261fe7f71174

Observation 435cf357-062f-443c-9ee5-664664da2f05 · outbound

This paper cites Adaptive test generation using a large language model,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Adaptive test generation using a large language model,

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.982546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.522577Z digest=sha256:0ea394f04175485a7b743bdb2a353faac8418752afefaf01f2999ca95854c9b0

Observation 79fb9caf-1921-44d4-b202-ce05d4d5b320 · outbound

This paper cites Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

Reference 13

Resolution
verified exact
local_arxiv, observed 2026-08-09T11:10:58.800061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.527434Z digest=sha256:e6679087a623721110743b92a36a89ec8522fd43d5b8dabf935c8563e73c39a0

Observation 55d3102d-a38d-40cf-8a95-09f1bd0f9b61 · outbound

This paper cites A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.532852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.532852Z digest=sha256:0e114297429a20017d0540a0676fcae144322f470233c38e09d803b40c815344

Observation 81cd43c4-0b04-4249-9825-3b4d5115912d · outbound

This paper cites Evosuite: automatic test suite generation for object-oriented software,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Evosuite: automatic test suite generation for object-oriented software,

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.537774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.537774Z digest=sha256:87d27120083c9ae754104e9aeebb5ff71bb96a5cb35e1ebab99b79fe5ce65e07

Observation 39318f00-ba44-4e13-b0b8-2aca65c3c5f7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.541890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.541890Z digest=sha256:4a08a5aaf0b2ab25e057ab1f7202c764c9e9d85b99dc2db478c8e9976cccb999

Observation 43cdf743-7104-410b-93e1-019d6b08761f · outbound

This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Self-Consistency Improves Chain of Thought Reasoning in Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.545907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.545907Z digest=sha256:1d96b15ff92397711e53238822b724be8481d99187b19f402836528832400c04

Observation 3adf1e15-1e64-48c7-ba65-1877d6aa8e64 · outbound

This paper cites Defects4j: A database of existing faults to enable controlled testing studies for java programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Defects4j: A database of existing faults to enable controlled testing studies for java programs,

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.550426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.550426Z digest=sha256:809a82cb3d8588cc0666f66d312cdf658cbcfd186e460e36ecafc2735ab87ccf

Observation 1013b392-e1e4-4f85-a6f0-eba24472ffcb · outbound

This paper cites Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.554435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.554435Z digest=sha256:a11a965a4e1e5adf0692d8fd20f12790436cf9d19cbf525f58e9d65ec5117562

Observation 606245b2-7cc3-46ba-aa4e-08686a6a01af · outbound

This paper cites Automatic Code Summarization via ChatGPT: How Far Are We?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Code Summarization via ChatGPT: How Far Are We?

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.559168Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.559168Z digest=sha256:1e2700783c1e0cd7f301e170c8beb8b88e414c2a385173b811467a476706c2c3

Observation 70a7b020-4105-4003-82ee-7acabd93fedd · outbound

This paper cites Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization).

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.564400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.564400Z digest=sha256:08abc918bb20f3ddee26f3dce6dc4359eba82ffa432d5c06cc1acc236c930ab3

Observation ffb2425c-2516-4357-b0f2-8a63ae6cb195 · outbound

This paper cites GPT-4 Technical Report.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries GPT-4 Technical Report

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.569635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.569635Z digest=sha256:ffc88dbb0f864e213d805b346c8876bb52a631d3c999f0c05961755797386cb1

Observation d0a217aa-5fd0-4739-95da-c5c2a7e5aa3d · outbound

This paper cites A survey on metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A survey on metamorphic testing,

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.574801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.574801Z digest=sha256:3a6d3660ba8a9d09b7d2846c09f3eede876f8eafed3bbc3369207f6c334b569f

Observation 3738edaf-d2f8-426e-acc5-d1382d3390f4 · outbound

This paper cites Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.934388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.580910Z digest=sha256:6336d164006aa87f5d3253214b0c292fd998b3cadd6b58c446c40d6a8d1335f7

Observation 5a1da619-48b1-47dc-a9a5-e1b2adf31d5b · outbound

This paper cites Properties of machine learning applications for use in metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Properties of machine learning applications for use in metamorphic testing,

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.919341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.587091Z digest=sha256:8ec10aa73b2e5929f0d91cb9681628436f200269fa6c321178d811b1d4aa91a0

Observation cc21ea90-f070-4b5b-bfa9-a58bb64c91f2 · outbound

This paper cites Testing and validating machine learning classifiers by metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Testing and validating machine learning classifiers by metamorphic testing,

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.904406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.593140Z digest=sha256:233e015c15d224c7cbb73ca275c688ba212d9891a30d7b5ccf84c1ea538db561

Observation 7826cce9-19bd-466b-92a5-115f6577d361 · outbound

This paper cites On Testing Non-Testable Programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries On Testing Non-Testable Programs,

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.888093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.598999Z digest=sha256:41317f1f5f1da177578dedebac6ff06aacf728c54e68f977de5adb55e782c03e

Observation f4c252ee-2ffe-4135-93cf-ccc0462356a7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.604514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.604514Z digest=sha256:4af34d3737b0eaf10565378d80be7bb7fca7610c32e6bcf55ed958ae3b343617

Observation c38f9cd1-b8f7-4363-b24a-f8620f2cdfea · outbound

This paper cites Major: An efficient and extensible tool for mutation analysis in a java compiler,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Major: An efficient and extensible tool for mutation analysis in a java compiler,

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.860398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T11:10:43.610161Z digest=sha256:3649b45dd06fd9dc58afb072dd089478f84ddb95e8978cb8ac2d04658a2091de

Pith citing papers

Observation 21730c79-ffe6-4b9d-b0e2-0bd0c2514b4f · inbound

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments cites this paper.

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:58:05.029561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T13:57:58.048943Z digest=sha256:d64ed1cc6a98d8e6159c5311fcd5e6b23eb83c9b9327612f87edbf5dc566399f