A user study of an astronomy RAG bot identifies the question types and evaluation criteria astronomers actually use, and turns them into a 40-item benchmark.
The effects of system initiative during conversational collaborative search
1 Pith paper cite this work, alongside 18 external citations. Polarity classification is still indexing.
1
Pith paper citing it
18
external citations · OpenAlex
citation-role summary
background 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
From Queries to Criteria: Understanding How Astronomers Evaluate LLMs
A user study of an astronomy RAG bot identifies the question types and evaluation criteria astronomers actually use, and turns them into a 40-item benchmark.