Pith. sign in

REVIEW 9 cited by

Can LLM-Generated Misinformation Be Detected?

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2309.13788 v5 pith:AR2EVEED submitted 2023-09-25 cs.CL cs.AIcs.CRcs.HCcs.LG

classification cs.CLcs.AIcs.CRcs.HCcs.LG
keywords misinformationllm-generatedllmscauseharmhuman-writtenpotentialquestion
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The advent of Large Language Models (LLMs) has made a transformative impact. However, the potential that LLMs such as ChatGPT can be exploited to generate misinformation has posed a serious concern to online safety and public trust. A fundamental research question is: will LLM-generated misinformation cause more harm than human-written misinformation? We propose to tackle this question from the perspective of detection difficulty. We first build a taxonomy of LLM-generated misinformation. Then we categorize and validate the potential real-world methods for generating misinformation with LLMs. Then, through extensive empirical investigation, we discover that LLM-generated misinformation can be harder to detect for humans and detectors compared to human-written misinformation with the same semantics, which suggests it can have more deceptive styles and potentially cause more harm. We also discuss the implications of our discovery on combating misinformation in the age of LLMs and the countermeasures.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 37 citations worldwide. Full citation record

  1. Tailored untruths: How personalisation challenges LLM safeguards

    cs.CL 2025-10 conditional novelty 7.0 of 10

    A 1.6-million-text study of eight LLMs in four languages finds that adding demographic personae to disinformation prompts raises jailbreak rates from 78% to 82%.

  2. Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation

    cs.HC 2025-06 conditional novelty 6.0 of 10

    In a 25-participant Werewolf-style game, all roles used an LLM chatbot strategically, as a sword for disinformation and a shield against it.

  3. Do people rely on ChatGPT more than their peers to detect deepfake news?

    econ.GN 2026-08 conditional novelty 5.0 of 10

    In a lab deepfake-detection task, students shifted more toward ChatGPT's advice than toward peers' advice (weight-of-advice 0.59 vs 0.33), though in 2025 sessions they trusted linguistic experts slightly more than ChatGPT.

  4. An Audit and Analysis of LLM-Assisted Health Misinformation Jailbreaks Against LLMs

    cs.CL 2025-08 conditional novelty 5.0 of 10

    LLM-generated jailbreak prompts elicited health misinformation from GPT-3.5, Llama 3.1-8B, and Gemini 2.0 Flash at high rates, and both LLM judges and simple classifiers detected the resulting texts with high accuracy.

  5. Are Today's LLMs Ready to Explain Well-Being Concepts?

    cs.CL 2025-08 unverdicted novelty 5.0 of 10

    AI judges can score explanations of well-being concepts, and small models fine-tuned with preference data score better than larger models, although judges and explainers are all AIs.

  6. The Compositional Architecture of Regret in Large Language Models

    cs.CL 2025-06 reject novelty 5.0 of 10

    The paper claims that regret in LLMs is encoded by interacting neuron groups detectable in the final hidden layer, using new S-CDI, RDS, and GIC metrics.

  7. Embodied AI: Emerging Risks and Opportunities for Policy Action

    cs.CY 2025-08 conditional novelty 4.0 of 10

    A policy analysis arguing that embodied AI risks are real, under-covered by current US/EU/UK frameworks, and best handled through certification, benchmarks, clarified liability, and economic adaptation.

  8. Invariant-based Robust Weights Watermark for Large Language Models

    cs.CR 2025-07 conditional novelty 4.0 of 10

    An invariant-based weights watermark embeds per-user keys into the null space of transformer invariants and uses noise to repel collusion.

  9. AI-Generated Content in Cross-Domain Applications: Research Trends, Challenges and Propositions

    cs.AI 2025-09 conditional novelty 2.0 of 10

    A cross-domain vision paper that surveys AI-generated content and proposes research directions, without introducing new empirical results.

Pith tools