REVIEW 7 cited by
Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce Buffer of Thoughts (BoT), a novel and versatile thought-augmented reasoning approach for enhancing accuracy, efficiency and robustness of large language models (LLMs). Specifically, we propose meta-buffer to store a series of informative high-level thoughts, namely thought-template, distilled from the problem-solving processes across various tasks. Then for each problem, we retrieve a relevant thought-template and adaptively instantiate it with specific reasoning structures to conduct efficient reasoning. To guarantee the scalability and stability, we further propose buffer-manager to dynamically update the meta-buffer, thus enhancing the capacity of meta-buffer as more tasks are solved. We conduct extensive experiments on 10 challenging reasoning-intensive tasks, and achieve significant performance improvements over previous SOTA methods: 11% on Game of 24, 20% on Geometric Shapes and 51% on Checkmate-in-One. Further analysis demonstrate the superior generalization ability and model robustness of our BoT, while requiring only 12% of the cost of multi-query prompting methods (e.g., tree/graph of thoughts) on average. Notably, we find that our Llama3-8B+BoT has the potential to surpass Llama3-70B model. Our project is available at: https://github.com/YangLing0818/buffer-of-thought-llm
Forward citations
Cited by 7 Pith papers
-
Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models
A training-free meta-reasoning loop that tracks remaining cognitive demand and steers an LLM's next action improves average accuracy by about 9 percent over chain-of-thought across three models and six benchmarks.
-
Knowledge-Centric Self-Improvement
A protocol that keeps agents generic and disposable while improving a persistent curated knowledge base outperforms agent-centric self-improvement baselines on ARC, coding, and terminal benchmarks.
-
Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent
TAIRA, a thought-pattern-augmented multi-agent recommender, outperforms prior LLM agents in simulated interactive recommendation, with the largest gains on complex user intents.
-
Excessive Reasoning Attack on Reasoning LLMs
A 10-token adversarial suffix, optimized with three custom losses, raises reasoning length 3x to 9x on open reasoning LLMs without hurting accuracy, and partly transfers to closed models.
-
Chain of Methodologies: Scaling Test Time Computation without Training
A prompt framework that interleaves methodology selection with reasoning steps improves LLM math and QA accuracy when combined with a Python interpreter, but the benefit of the methodology selection itself is small an...
-
Thinking Before You Speak: A Proactive Test-time Scaling Approach
TBYS inserts generated situation-and-goal insights between reasoning steps and reports math accuracy gains, but the insight library is filtered using test-set answers.
-
Reflection-Based Memory For Web navigation Agents
Reflection-Augmented Planning (ReAP) retrieves short self-reflections from past web navigation tasks and lifts held-out task success by 11 points on WebArena.
Discussion (0). Continue with ORCID to comment.