REVIEW 6 cited by
Tapping the Potential of Large Language Models as Recommender Systems: A Comprehensive Framework and Empirical Analysis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Recently, Large Language Models~(LLMs) such as ChatGPT have showcased remarkable abilities in solving general tasks, demonstrating the potential for applications in recommender systems. To assess how effectively LLMs can be used in recommendation tasks, our study primarily focuses on employing LLMs as recommender systems through prompting engineering. We propose a general framework for utilizing LLMs in recommendation tasks, focusing on the capabilities of LLMs as recommenders. To conduct our analysis, we formalize the input of LLMs for recommendation into natural language prompts with two key aspects, and explain how our framework can be generalized to various recommendation scenarios. As for the use of LLMs as recommenders, we analyze the impact of public availability, tuning strategies, model architecture, parameter scale, and context length on recommendation results based on the classification of LLMs. As for prompt engineering, we further analyze the impact of four important components of prompts, \ie task descriptions, user interest modeling, candidate items construction and prompting strategies. In each section, we first define and categorize concepts in line with the existing literature. Then, we propose inspiring research questions followed by detailed experiments on two public datasets, in order to systematically analyze the impact of different factors on performance. Based on our empirical analysis, we finally summarize promising directions to shed lights on future research.
Forward citations
Cited by 6 Pith papers
-
Biases in LLM-Generated Musical Taste Profiles for Recommendation
Users identify more with LLM-generated music taste profiles for some genres and user groups than others, and these biases differ across models.
-
PageLLM: A Multi-Grained Reward Framework for Whole-Page Optimization with Large Language Models
A multi-grained reward framework fine-tunes an LLM with PPO to generate whole-page recommendations, showing that page-level and item-level reward heads are complementary.
-
Tokenizing Numerical and Embedding Features for LLM RecSys
Interaction-based soft-token fusion of numerical and embedding features improves LLM two-tower retrieval over text-only and direct-concatenation baselines on three Amazon datasets.
-
R4ec: A Reasoning, Reflection, and Refinement Framework for Recommendation Systems
R4ec trains a small reflection model to critique and refine LLM-generated user and item knowledge, which then improves downstream recommendation accuracy.
-
Just Ask for Music (JAM): Multimodal and Personalized Natural Language Music Recommendation
JAM models natural-language music queries as vector translations from user to item embeddings, and with cross-attention fusion of audio, lyrics, and collaborative-filtering signals it outperforms the tested baselines ...
-
Demystifying ChatGPT: How It Masters Genre Recognition
A benchmark reports that ChatGPT outperforms other LLMs and traditional classifiers on multi-label movie genre prediction, but the result is undermined by likely pretraining contamination and weak baselines.
Discussion (0). Sign in to comment.