REVIEW 11 cited by
Integrating Summarization and Retrieval for Enhanced Personalization via Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Personalization, the ability to tailor a system to individual users, is an essential factor in user experience with natural language processing (NLP) systems. With the emergence of Large Language Models (LLMs), a key question is how to leverage these models to better personalize user experiences. To personalize a language model's output, a straightforward approach is to incorporate past user data into the language model prompt, but this approach can result in lengthy inputs exceeding limitations on input length and incurring latency and cost issues. Existing approaches tackle such challenges by selectively extracting relevant user data (i.e. selective retrieval) to construct a prompt for downstream tasks. However, retrieval-based methods are limited by potential information loss, lack of more profound user understanding, and cold-start challenges. To overcome these limitations, we propose a novel summary-augmented approach by extending retrieval-augmented personalization with task-aware user summaries generated by LLMs. The summaries can be generated and stored offline, enabling real-world systems with runtime constraints like voice assistants to leverage the power of LLMs. Experiments show our method with 75% less of retrieved user data is on-par or outperforms retrieval augmentation on most tasks in the LaMP personalization benchmark. We demonstrate that offline summarization via LLMs and runtime retrieval enables better performance for personalization on a range of tasks under practical constraints.
Forward citations
Cited by 11 Pith papers
-
Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis
HiCUPID is a synthetic benchmark for personalized LLM assistants, with multi-hop questions and a distilled Llama-3.2 evaluator that closely matches human preferences on a small validation set.
-
Synthetic Interaction Data for Scalable Personalization in Large Language Models
PersonaGym simulates noisy multi-turn user–assistant interactions to build PersonaAtlas, and PPOpt learns to rewrite user prompts from interaction history, improving judged personalization on synthetic benchmarks.
-
PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization
PersonaFeedback provides a human-labeled benchmark showing current LLMs, including strong reasoners, score only about 65-70 percent on hard personalization choices, and explicit persona information helps more than retrieval.
-
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents
PersonaAgent personalizes LLM agents by combining episodic and semantic memory with a per-user system 'persona' that is optimized at test time using textual gradients.
-
Personas within Parameters: Fine-Tuning Small Language Models with Low-Rank Adapters to Mimic User Behaviors
Persona-level LoRA fine-tuning lets a 3.8B small language model simulate MovieLens users about as accurately as a much larger frozen LLM, at lower cost.
-
CLAImate: AI-Enabled Climate Change Communication through Personalized and Localized Narrative Visualizations
A personalized, localized AI conversation system for climate communication shows modest factual accuracy and positive early feedback from 10 UK users.
-
Reasoning Meets Personalization: Unleashing the Potential of Large Reasoning Model for Personalized Generation
Large reasoning models underperform general chat models on personalization tasks, but a structured template plus self-checking and self-referencing restores and improves performance.
-
Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMs
PsPLUG, a soft-prompt plug-in trained with style-conditioned preference pairs, preserves user identity under explicit style instructions and lets users tune personalization strength via an α scalar.
-
Igniting Creative Writing in Small Language Models: LLM-as-a-Judge versus Multi-Agent Refined Rewards
An adversarially tuned LLM-as-a-Judge reward signal outperforms a multi-agent-refined reward model for fine-tuning a 7B SLM on Chinese greeting generation, though the comparison is weakened by circular evaluation and ...
-
A Survey on Training-free Alignment of Large Language Models
A survey that catalogs and categorizes training-free LLM alignment methods into pre-decoding, in-decoding, and post-decoding, with a limited experimental comparison on one model.
-
Personalised Explanations in Long-term Human-Robot Interactions
A two-stage LLM pipeline that first generates an explanation and then personalises it using a stored user knowledge memory reduces explanation length only when the user has related prior knowledge, in synthetic hospit...
Discussion (0). Continue with ORCID to comment.