REVIEW 4 cited by
CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large Language Models (LLMs) have shown great ability in solving traditional natural language tasks and elementary reasoning tasks with appropriate prompting techniques. However, their ability is still limited in solving complicated science problems. In this work, we aim to push the upper bound of the reasoning capability of LLMs by proposing a collaborative multi-agent, multi-reasoning-path (CoMM) prompting framework. Specifically, we prompt LLMs to play different roles in a problem-solving team, and encourage different role-play agents to collaboratively solve the target task. In particular, we discover that applying different reasoning paths for different roles is an effective strategy to implement few-shot prompting approaches in the multi-agent scenarios. Empirical results demonstrate the effectiveness of the proposed methods on two college-level science problems over competitive baselines. Our further analysis shows the necessity of prompting LLMs to play different roles or experts independently. We release the code at: https://github.com/amazon-science/comm-prompt
Forward citations
Cited by 4 Pith papers
-
Learning from Peers in Reasoning Models
Sharing intermediate summaries between parallel reasoning paths during generation improves reasoning-model accuracy and helps models recover from bad starts.
-
Synergizing Logical Reasoning, Knowledge Management and Collaboration in Multi-Agent LLM System
SynergyMAS combines a graph database with a Clingo logic solver, corrective RAG, and Theory of Mind prompts in a hierarchical multi-agent team, demonstrated on a Smart Home Energy Management case study.
-
Trace-of-Thought Prompting: Investigating Prompt-Based Knowledge Distillation Through Question Decomposition
A two-stage prompting method where a large model generates solution steps and a smaller model follows them; GSM8K gains are significant, MATH gains are not.
-
Enhancing LLM Reasoning with Multi-Path Collaborative Reactive and Reflection agents
A multi-path, reactive-plus-reflection agent framework improves gpt-3.5-turbo accuracy on MMLU physics, math, and moral reasoning subsets compared with CoT, self-consistency, and self-refine baselines.
Discussion (0). Continue with ORCID to comment.