The reviewed record of science sign in
Pith

arxiv: 2508.15817 · v1 · pith:UA5HQZSS · submitted 2025-08-17 · cs.CL · cs.CY

Meet Your New Client: Writing Reports for AI -- Benchmarking Information Loss in Market Research Deliverables

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:UA5HQZSSrecord.jsonopen to challenge →

classification cs.CL cs.CY
keywords deliverablesinformationreportsresearchsystemsanswerlosslost
0
0 comments X
read the original abstract

As organizations adopt retrieval-augmented generation (RAG) for their knowledge management systems (KMS), traditional market research deliverables face new functional demands. While PDF reports and slides have long served human readers, they are now also "read" by AI systems to answer user questions. To future-proof reports being delivered today, this study evaluates information loss during their ingestion into RAG systems. It compares how well PDF and PowerPoint (PPTX) documents converted to Markdown can be used by an LLM to answer factual questions in an end-to-end benchmark. Findings show that while text is reliably extracted, significant information is lost from complex objects like charts and diagrams. This suggests a need for specialized, AI-native deliverables to ensure research insights are not lost in translation.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. PeerPrism: Peer Evaluation Expertise vs Review-writing AI

    cs.CL 2026-04 unverdicted novelty 7.0

    PeerPrism benchmark demonstrates that state-of-the-art LLM detectors conflate surface text style with intellectual contribution and fail on hybrid human-AI peer reviews.