Pith. sign in

REVIEW 12 cited by

MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.08239 v2 pith:D5PE6RTD submitted 2023-08-16 cs.CL

classification cs.CL
keywords long-rangememochatconversationsinstructionsllmsmemosopen-domainconsistency
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We propose MemoChat, a pipeline for refining instructions that enables large language models (LLMs) to effectively employ self-composed memos for maintaining consistent long-range open-domain conversations. We demonstrate a long-range open-domain conversation through iterative "memorization-retrieval-response" cycles. This requires us to carefully design tailored tuning instructions for each distinct stage. The instructions are reconstructed from a collection of public datasets to teach the LLMs to memorize and retrieve past dialogues with structured memos, leading to enhanced consistency when participating in future conversations. We invite experts to manually annotate a test set designed to evaluate the consistency of long-range conversations questions. Experiments on three testing scenarios involving both open-source and API-accessible chatbots at scale verify the efficacy of MemoChat, which outperforms strong baselines. Our codes, data and models are available here: https://github.com/LuJunru/MemoChat.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Hierarchical Graph Memory for LLM Agents with Path-level Localization and Rewrite

    cs.AI 2026-08 conditional novelty 6.0 of 10

    HiGram is a hierarchical graph memory with path-level localization and coordinated rewriting that improves long-term QA accuracy and token efficiency for LLM agents.

  2. MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agents

    cs.AI 2026-08 conditional novelty 6.0 of 10

    MemSIF improves long-term LLM agent memory by combining structured interaction organization with dual-track fact memory, reporting top Total ACC on LoCoMo and LongMemEval-S across five backbones.

  3. HGMEM: Hypergraph-based Working Memory to Improve Multi-step RAG for Long-Context Complex Relational Modeling

    cs.CL 2025-12 conditional novelty 6.0 of 10

    A working memory represented as a hypergraph, whose hyperedges are updated, inserted, and progressively merged by the LLM, improves multi-step RAG on long-context sense-making benchmarks.

  4. MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent

    cs.CL 2025-07 unverdicted novelty 6.0 of 10

    MemAgent uses multi-conversation RL to train a memory agent that reads text in segments and overwrites memory, extrapolating from 8K training to 3.5M token QA with under 5% loss and 95%+ on 512K RULER.

  5. PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants

    cs.CL 2025-06 conditional novelty 6.0 of 10

    PersonaLens uses LLM-simulated users and an LLM judge to evaluate personalization in task-oriented conversational assistants across 111 tasks and 20 domains.

  6. G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems

    cs.MA 2025-06 conditional novelty 6.0 of 10

    G-Memory stores past multi-agent teamwork in a three-tier graph and retrieves it to boost performance on five benchmarks.

  7. MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents

    cs.CL 2025-05 conditional novelty 6.0 of 10

    MemGuide retrieves and filters past dialogue memories by intent and missing slots, and on its new synthetic benchmark MS-TOD it improves task success by 11 points and shortens dialogues by 2.84 turns.

  8. Writing Like the Best: Exemplar-Based Expository Text Generation

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Exemplar-based expository generation: a recurrent plan-then-adapt LLM framework converts a source topic's exemplar into target-topic text by question transfer, retrieval, and confidence-gated answering.

  9. ConMem: Contribution-Aware Memory for Long-Horizon Manufacturing Inspection Logs

    cs.AI 2026-07 conditional novelty 5.5 of 10

    Role-segmented inspection memories ranked by approximated Shapley contribution yield 76% early-risk QA accuracy with ~88% fewer tokens than naive 8K-context LLMs.

  10. Bridging Inference-Time Scaling and Episodic Memory with Action-Centric Graphs

    cs.AI 2026-07 conditional novelty 5.0 of 10

    Graph-based action memory with dual-stream TD learning improves best-of-N inference scaling for LLM agents, reporting +20.81% success / +6.17% progress over vanilla baselines.

  11. Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents

    cs.AI 2025-02 conditional novelty 5.0 of 10

    The authors propose episodic memory, with five defining properties, as the unifying framework needed for LLM agents to learn and remember over long time horizons.

  12. Toward Efficient Agents: Memory, Tool learning, and Planning

    cs.AI 2026-01 conditional novelty 3.0 of 10

    A survey that organizes efficiency techniques for LLM agents into memory, tool learning, and planning, and consolidates benchmarks and metrics for measuring cost-performance trade-offs.

Pith tools