Pith. sign in

REVIEW 7 cited by

SurveyX: Academic Survey Automation via Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2502.14776 v2 pith:SONAUQJS submitted 2025-02-20 cs.CL

classification cs.CL
keywords surveysurveyxgenerationautomatedevaluationcontentefficienthuman
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large Language Models (LLMs) have demonstrated exceptional comprehension capabilities and a vast knowledge base, suggesting that LLMs can serve as efficient tools for automated survey generation. However, recent research related to automated survey generation remains constrained by some critical limitations like finite context window, lack of in-depth content discussion, and absence of systematic evaluation frameworks. Inspired by human writing processes, we propose SurveyX, an efficient and organized system for automated survey generation that decomposes the survey composing process into two phases: the Preparation and Generation phases. By innovatively introducing online reference retrieval, a pre-processing method called AttributeTree, and a re-polishing process, SurveyX significantly enhances the efficacy of survey composition. Experimental evaluation results show that SurveyX outperforms existing automated survey generation systems in content quality (0.259 improvement) and citation quality (1.76 enhancement), approaching human expert performance across multiple evaluation dimensions. Examples of surveys generated by SurveyX are available on www.surveyx.cn

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problem

    cs.CL 2026-02 conditional novelty 6.0 of 10

    Idea evaluation can be automated with LLM agents that retrieve heterogeneous online evidence, simulate diverse reviewers, and score ideas on multiple dimensions, outperforming existing judges on acceptance-label predi...

  2. SurveyLens: A Discipline-Aware Benchmark for Automatic Survey Generation

    cs.CL 2026-02 conditional novelty 6.0 of 10

    SurveyLens benchmarks AI survey generators on 1,000 human-written surveys from 10 disciplines, finding Deep Research agents most robust and reference quality weakest everywhere.

  3. DeepSurvey-Bench: Evaluating Academic Value of Automatically Generated Scientific Surveys

    cs.AI 2026-01 conditional novelty 5.0 of 10

    A benchmark with human-annotated academic-value labels and seven LLM-judged metrics for evaluating whether automatically generated scientific surveys have real academic value.

  4. ResearchPulse: Building Method-Experiment Chains through Multi-Document Scientific Inference

    cs.CL 2025-09 conditional novelty 5.0 of 10

    ResearchPulse extracts motivation-method chains and experimental trends from related papers, rendering them as mind maps and line charts, and releases a 100-cluster benchmark; the reported '7B beats GPT-4o' result is ...

  5. SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systems

    cs.CL 2025-08 unverdicted novelty 5.0 of 10

    SGSimEval is a multifaceted benchmark showing that automatic survey generation systems match humans on outline quality but lag on content and references.

  6. AI for Auto-Research: Roadmap & User Guide

    cs.AI 2026-05 unverdicted novelty 4.0 of 10

    The paper delivers a stage-by-stage roadmap for AI in research, showing reliable assistance in retrieval and tool tasks but fragility in novelty and judgment, advocating human-governed collaboration.

  7. How Far Are AI Scientists from Changing the World?

    cs.AI 2025-07 conditional novelty 4.0 of 10

    This survey proposes a four-level capability framework for AI Scientist systems and, using an AI reviewer, finds that current systems produce papers rated well below normal scientific standards.

Pith tools