The reviewed record of science sign in
Pith

arxiv: 2412.03775 · v1 · pith:6XMASQ2B · submitted 2024-12-04 · cs.CL · cs.DL· cs.LG

WithdrarXiv: A Large-Scale Dataset for Retraction Study

Delip Rao , Jonathan Young , Thomas Dietterich , Chris Callison-Burch This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:6XMASQ2Brecord.jsonopen to challenge →

classification cs.CL cs.DLcs.LG
keywords retractionscientificautomatedcommentsdatasetlarge-scalereasonsrelease
0
0 comments X
read the original abstract

Retractions play a vital role in maintaining scientific integrity, yet systematic studies of retractions in computer science and other STEM fields remain scarce. We present WithdrarXiv, the first large-scale dataset of withdrawn papers from arXiv, containing over 14,000 papers and their associated retraction comments spanning the repository's entire history through September 2024. Through careful analysis of author comments, we develop a comprehensive taxonomy of retraction reasons, identifying 10 distinct categories ranging from critical errors to policy violations. We demonstrate a simple yet highly accurate zero-shot automatic categorization of retraction reasons, achieving a weighted average F1-score of 0.96. Additionally, we release WithdrarXiv-SciFy, an enriched version including scripts for parsed full-text PDFs, specifically designed to enable research in scientific feasibility studies, claim verification, and automated theorem proving. These findings provide valuable insights for improving scientific quality control and automated verification systems. Finally, and most importantly, we discuss ethical issues and take a number of steps to implement responsible data release while fostering open science in this area.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. TheoremGraph: Bridging Formal and Informal Mathematics

    cs.IR 2026-06 unverdicted novelty 7.0

    TheoremGraph builds a unified statement-level dependency graph across informal arXiv math and formal Lean code via parsing, embeddings, and LLM validation, releasing the data and APIs for search and retrieval.

  2. Hidden Secrets in the arXiv: Discovering, Analyzing, and Preventing Unintentional Information Disclosure in Source Files of Scientific Preprints

    cs.CR 2026-04 unverdicted novelty 7.0

    Nearly every arXiv submission leaks hidden sensitive information through its source files, existing cleaners fail, and ALC-NG provides a more reliable fix.

  3. SciCoQA: Quality Assurance for Scientific Paper--Code Alignment

    cs.CL 2026-01 conditional novelty 6.0

    SciCoQA benchmark reveals that even the strongest LLMs detect fewer than half of real discrepancies between scientific papers and their code.