REVIEW 12 cited by
MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We propose MemoChat, a pipeline for refining instructions that enables large language models (LLMs) to effectively employ self-composed memos for maintaining consistent long-range open-domain conversations. We demonstrate a long-range open-domain conversation through iterative "memorization-retrieval-response" cycles. This requires us to carefully design tailored tuning instructions for each distinct stage. The instructions are reconstructed from a collection of public datasets to teach the LLMs to memorize and retrieve past dialogues with structured memos, leading to enhanced consistency when participating in future conversations. We invite experts to manually annotate a test set designed to evaluate the consistency of long-range conversations questions. Experiments on three testing scenarios involving both open-source and API-accessible chatbots at scale verify the efficacy of MemoChat, which outperforms strong baselines. Our codes, data and models are available here: https://github.com/LuJunru/MemoChat.
Forward citations
Cited by 12 Pith papers
-
Hierarchical Graph Memory for LLM Agents with Path-level Localization and Rewrite
HiGram is a hierarchical graph memory with path-level localization and coordinated rewriting that improves long-term QA accuracy and token efficiency for LLM agents.
-
MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agents
MemSIF improves long-term LLM agent memory by combining structured interaction organization with dual-track fact memory, reporting top Total ACC on LoCoMo and LongMemEval-S across five backbones.
-
HGMEM: Hypergraph-based Working Memory to Improve Multi-step RAG for Long-Context Complex Relational Modeling
A working memory represented as a hypergraph, whose hyperedges are updated, inserted, and progressively merged by the LLM, improves multi-step RAG on long-context sense-making benchmarks.
-
MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent
MemAgent uses multi-conversation RL to train a memory agent that reads text in segments and overwrites memory, extrapolating from 8K training to 3.5M token QA with under 5% loss and 95%+ on 512K RULER.
-
PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants
PersonaLens uses LLM-simulated users and an LLM judge to evaluate personalization in task-oriented conversational assistants across 111 tasks and 20 domains.
-
G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems
G-Memory stores past multi-agent teamwork in a three-tier graph and retrieves it to boost performance on five benchmarks.
-
MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents
MemGuide retrieves and filters past dialogue memories by intent and missing slots, and on its new synthetic benchmark MS-TOD it improves task success by 11 points and shortens dialogues by 2.84 turns.
-
Writing Like the Best: Exemplar-Based Expository Text Generation
Exemplar-based expository generation: a recurrent plan-then-adapt LLM framework converts a source topic's exemplar into target-topic text by question transfer, retrieval, and confidence-gated answering.
-
ConMem: Contribution-Aware Memory for Long-Horizon Manufacturing Inspection Logs
Role-segmented inspection memories ranked by approximated Shapley contribution yield 76% early-risk QA accuracy with ~88% fewer tokens than naive 8K-context LLMs.
-
Bridging Inference-Time Scaling and Episodic Memory with Action-Centric Graphs
Graph-based action memory with dual-stream TD learning improves best-of-N inference scaling for LLM agents, reporting +20.81% success / +6.17% progress over vanilla baselines.
-
Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents
The authors propose episodic memory, with five defining properties, as the unifying framework needed for LLM agents to learn and remember over long time horizons.
-
Toward Efficient Agents: Memory, Tool learning, and Planning
A survey that organizes efficiency techniques for LLM agents into memory, tool learning, and planning, and consolidates benchmarks and metrics for measuring cost-performance trade-offs.
Discussion (0). Continue with ORCID to comment.