Counted as completed checks in the claim sentence numerator.
Paper Integrity Record · LEDGER
RepoProbe: Benchmarking Architecture-Aware Repository Comprehension with Checklists
As of 8 August 2026, Pith completed 7 of 9 listed checks against arXiv:2608.04783. The completed checks produced 3 public findings within their stated scope. 2 checks were skipped and produced no result.
This is a record of named checks, not a clean-status claim or a paper verdict.
Coverage vector
Skipped checks produced no result and say nothing about absence.
Listed checks
doi_compliance
completedv1.1.0, observed 2026-08-08 13:58:11.511518+00:00
- Scope
- DOI and arXiv identifiers listed in the bibliography checked against named registries.
- Completed surface
- Completed within the stated scope.
claim_evidence
completedv1.0.0, observed 2026-08-08 13:48:06.981373+00:00
- Scope
- Recorded paper claims checked for the evidence artifacts they name.
- Completed surface
- Completed within the stated scope.
doi_title_agreement
completedv1.0.0, observed 2026-08-08 13:38:31.731742+00:00
- Scope
- Cited titles compared with titles resolved from their DOI or arXiv identifier.
- Completed surface
- Completed within the stated scope.
doi_title_agreement
completedv1.0.0, observed 2026-08-06 17:08:24.280279+00:00
- Scope
- Cited titles compared with titles resolved from their DOI or arXiv identifier.
- Completed surface
- Checked 1 reference.
doi_compliance
completedv1.1.0, observed 2026-08-06 16:48:28.226769+00:00
- Scope
- DOI and arXiv identifiers listed in the bibliography checked against named registries.
- Completed surface
- Checked 32 references. Recorded 3 findings from this run.
citation_quote_validity
skippedv0.1.0, observed 2026-08-06 11:08:41.789848+00:00
- Scope
- Specific factual attributions checked against cited-paper text available in Pith.
- Reason
- Paper body text was unavailable.
cited_work_retraction
completedv1.0.0, observed 2026-08-06 08:08:07.184222+00:00
- Scope
- Cited references checked for source-reported retractions or expressions of concern.
- Completed surface
- Completed within the stated scope.
ai_meta_artifact
skippedv1.0.0, observed 2026-08-06 02:09:29.246538+00:00
- Scope
- Paper body text scanned for literal AI-assistant artifacts.
- Reason
- Paper body text was unavailable.
claim_evidence
completedv1.0.0, observed 2026-08-06 02:08:14.289363+00:00
- Scope
- Recorded paper claims checked for the evidence artifacts they name.
- Completed surface
- Completed within the stated scope.
Observations
Methods and limits
Each listed check names the surface it examined. A skipped, failed, partial, unavailable, not collected, not requested, or withheld check says nothing about what a completed check would have returned.
- Only checks with status completed enter the claim sentence numerator.
- Findings appear only from completed checks and only within the scope printed for that check.
- Severity labels describe one observation row. They do not roll up into a paper judgment.