Pith. sign in

Paper Citation Record · LEDGER

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals

As of 21 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.14597.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.14597 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:36:04.013632Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy12
  • unresolved8
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 40acdc18-3ae6-41de-85e3-11e4ebb91c73 · outbound

This paper cites Given a string consisting of three letters ’abc’ in any order, can ’abc’ appear after swapping any two characters at most once?.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Given a string consisting of three letters ’abc’ in any order, can ’abc’ appear after swapping any two characters at most once?

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:05.002398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.509269Z digest=sha256:55cdb24e330a8eefb326a50bbc5ad4d04e9ce6fdc936e7bb4fa30a17577019c6

Observation bfb0e8d5-4734-4ff2-8b54-8a3e0d6aeab5 · outbound

This paper cites OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:01.982429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:01.982429Z digest=sha256:802eb6e6a92eaf2fb683b95b2ca41826fb1a50be0b03bcdb60a6192bf1254055

Observation bcc6c9f0-14bc-47fe-b86b-9bfe64d38457 · outbound

This paper cites Qwen2.5 Technical Report.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Qwen2.5 Technical Report

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.123222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.123222Z digest=sha256:7a40c2ebd85cca411dc93d2e2d5208b9bf745b7df19c84705aba1a72d3828fc7

Observation b058e484-e7c4-4592-b354-6547f6154de9 · outbound

This paper cites DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.257975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.257975Z digest=sha256:2f6b4c47cf0995307917db054bb8e5df9962a7eb562a84fd1b008996dd48e605

Observation 75da96c6-1cab-4bb0-ab97-177cad38b227 · outbound

This paper cites DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.357541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.357541Z digest=sha256:f19cc2d04f2ddb35bad734cd63957f27d7bd0662f8228f16f131572aae341ef4

Observation 5244f18a-f846-4155-9187-169eabc9ee14 · outbound

This paper cites If there are errors in the Sample Input/Output or in the Test Cases , correct them.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals If there are errors in the Sample Input/Output or in the Test Cases , correct them

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.983196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.605549Z digest=sha256:ce80b4a650888fe14f30936d81aa876cbd0b7da6a5cad561b793c36fa146f1a2

Observation 5d821b14-d9ad-40d4-9513-ea9125f45084 · outbound

This paper cites any substring can be reversed.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals any substring can be reversed

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.965264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.673372Z digest=sha256:18680454b021f7e34c790ec42a8029ebf8b9be89a6f169ffbb53a618da9a55a7

Observation 80ae524a-cb00-425b-9970-7d641dca56f7 · outbound

This paper cites YES" if it is possible, and.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals YES" if it is possible, and

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.947355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.752000Z digest=sha256:39ca3486774034b6b1e042e568f63ddc8ceb87662a62511892e2443f614b2b00

Observation a2c9eae4-788b-4e53-b76e-ca512d78f8ae · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.928662Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.878731Z digest=sha256:d4166b52b61675663f2303cbf53ac430bbbd4dc22083e2ecbc575aeb16312523

Observation 0dbb3029-7aa3-4920-8a6a-fd7934dc97c3 · outbound

This paper cites **The modification should be slight but cause a substantial change in the solution approach**.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals **The modification should be slight but cause a substantial change in the solution approach**

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.912357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:02.963580Z digest=sha256:236bbad83dabb7be56864fee8601c3e0ee762ddb2f1fd143c311aa7f76ec6691

Observation cab61e97-2839-416b-acea-2d96fea3801c · outbound

This paper cites Ask yourself: Would it change data structures or algorithms? Explain the influence before output the counterfactual problem.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Ask yourself: Would it change data structures or algorithms? Explain the influence before output the counterfactual problem

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.895731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.072577Z digest=sha256:92eaa776d8949e79eb81823fe307f2164ba2e93f761d75306e0d886ef5d18914

Observation 444eb4aa-0ec1-4a71-9b2d-bc7cd6da07b1 · outbound

This paper cites The modified problem must be consistent, clear, and requires a significantly different solution approach.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals The modified problem must be consistent, clear, and requires a significantly different solution approach

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.879583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.144101Z digest=sha256:309d24a3ef7f07201f0837e440213e5885418dd1dc38939b01aca8bcb2689b70

Observation 229d927b-7d81-446b-ab80-864a61d7b990 · outbound

This paper cites ###Counterfactual Problem.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals ###Counterfactual Problem

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.863080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.251867Z digest=sha256:378d0e6cdc65ed2897b4eed4554d578f8e51991d96712f9382d12b18e26a5d7d

Observation 8300915f-4c68-4f17-b32f-a82c332590fd · outbound

This paper cites The difference will be assessed through evaluated by the Rouge score, indicating the high similarity in wording, sentence structure, and length to the original.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals The difference will be assessed through evaluated by the Rouge score, indicating the high similarity in wording, sentence structure, and length to the original

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.844973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.341933Z digest=sha256:f8797d2d7cb15cf0037a86f08f736d0d9e2c983462ae108cd01c546d9fad12a5

Observation f92a8757-784e-45e8-a708-7284f93d2e7a · outbound

This paper cites Do not make trivial changes like adding or removing a word, changing the order of words, or replacing synonyms.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Do not make trivial changes like adding or removing a word, changing the order of words, or replacing synonyms

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.824837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.450520Z digest=sha256:f7f32bd8191cf3ece76cf2b3274464a3e17d1d92e9bb61352cd977378a037a0d

Observation 49d357bf-340e-4212-a95d-9d86425c82cc · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.803578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.511775Z digest=sha256:f49ba084b17c4bda6716bdfe9930aa0228cd18a14b431475336310cae05ab7f9

Observation c2cbab0b-1fda-4c90-a5cb-91a861ffbde2 · outbound

This paper cites Change every aspect of the code, including the function name, variable names.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Change every aspect of the code, including the function name, variable names

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.786127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.596017Z digest=sha256:46bc346d11f0d12af0a602fea46771ccea79ebd9ff5bdf98bdbe7bc7f79bd412

Observation 84996287-8ec0-4471-84a2-16a06cee2cb2 · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.681708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.728800Z digest=sha256:3a4c99dc5058937a84c5ac8de073e43c4b32fcc3a258445da95dc929055d5216

Observation 09fd4e6e-a227-480a-9177-68f00f819cda · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.532016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:03.893320Z digest=sha256:15d30c2b019198002917283a1f06e959f4e2e28904265301fa665b3c3c978708

Observation 8d4bd803-07bf-413f-b8e9-352581f138c0 · outbound

This paper cites ## Examples: {seeds} ## Question: - Original_Sample: Figure 16: The prompt used to generate CTF-Instruct data.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals ## Examples: {seeds} ## Question: - Original_Sample: Figure 16: The prompt used to generate CTF-Instruct data

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.308762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-07T15:36:04.013632Z digest=sha256:71f5d7dbb0aa6c8167658093f1b79d97ec737abb13702538e2ce164c697d50c5

Pith citing papers

No inbound Pith citation observations are available.