GBQA benchmark shows the best frontier LLM finds only 48.39% of verified game bugs using a multi-round ReAct agent with memory.
Environment:CASTLE Candidate Report:The bedroom description reveals that there is a small key inside the bedside drawer even though the drawer has not been opened yet
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
GBQA: A Game Benchmark for Evaluating LLMs as Quality Assurance Engineers
GBQA benchmark shows the best frontier LLM finds only 48.39% of verified game bugs using a multi-round ReAct agent with memory.