REVIEW 6 cited by
Raidar: geneRative AI Detection viA Rewriting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We find that large language models (LLMs) are more likely to modify human-written text than AI-generated text when tasked with rewriting. This tendency arises because LLMs often perceive AI-generated text as high-quality, leading to fewer modifications. We introduce a method to detect AI-generated content by prompting LLMs to rewrite text and calculating the editing distance of the output. We dubbed our geneRative AI Detection viA Rewriting method Raidar. Raidar significantly improves the F1 detection scores of existing AI content detection models -- both academic and commercial -- across various domains, including News, creative writing, student essays, code, Yelp reviews, and arXiv papers, with gains of up to 29 points. Operating solely on word symbols without high-dimensional features, our method is compatible with black box LLMs, and is inherently robust on new content. Our results illustrate the unique imprint of machine-generated text through the lens of the machines themselves.
Forward citations
Cited by 6 Pith papers
-
ARB: A Matched Authorship-Rewriting Benchmark Dataset for AI-Text Detector Evaluation
A matched four-regime benchmark shows AI-text detectors catch direct LLM output but lose most of their recall on human text rewritten by an LLM.
-
Who Gets Seen in the Age of AI? Adoption Patterns of Large Language Models in Scholarly Writing and Citation Outcomes
Analyzing 98,000 Scopus computer science papers, the paper finds a global rise in AI-like writing after ChatGPT and reports regional differences in citation returns, but the key differential-gain result is statistical...
-
A Comprehensive Dataset for Human vs. AI Generated Text Detection
A dataset of ~58k NYT articles plus AI rewrites from six LLMs, evaluated with a rewrite-distance baseline reaching 58.35% detection and 8.92% attribution accuracy.
-
AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models
Fine-tuned GPT-4o-mini detects AI versus human text at 95.5% F1 on the DeFactify test set, but identifying the specific generator LLM reaches only 47% F1 with BERT.
-
Efficient Online LLM Watermark Detection via Rao-Blackwellized E-Processes
A one-pass e-process detector for the Gumbel-max LLM watermark preserves anytime-valid Type I error control while accumulating evidence token by token.
-
Survey on AI-Generated Media Detection: From Non-MLLM to MLLM
A survey organizing AI-generated media detection into Non-MLLM and MLLM based methods, with task and benchmark taxonomies.
Discussion (0). Continue with ORCID to comment.