Pith. sign in

REVIEW 1 cited by

Exploring Adapter-based Transfer Learning for Recommender Systems: Empirical Studies and Practical Insights

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2305.15036 v2 pith:MRFKCQR4 submitted 2023-05-24 cs.IR

classification cs.IR
keywords transrecadapter-basedrecommendationlearningadaptersitemtasksdata
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Adapters, a plug-in neural network module with some tunable parameters, have emerged as a parameter-efficient transfer learning technique for adapting pre-trained models to downstream tasks, especially for natural language processing (NLP) and computer vision (CV) fields. Meanwhile, learning recommendation models directly from raw item modality features -- e.g., texts of NLP and images of CV -- can enable effective and transferable recommender systems (called TransRec). In view of this, a natural question arises: can adapter-based learning techniques achieve parameter-efficient TransRec with good performance? To this end, we perform empirical studies to address several key sub-questions. First, we ask whether the adapter-based TransRec performs comparably to TransRec based on standard full-parameter fine-tuning? does it hold for recommendation with different item modalities, e.g., textual RS and visual RS. If yes, we benchmark these existing adapters, which have been shown to be effective in NLP and CV tasks, in item recommendation tasks. Third, we carefully study several key factors for the adapter-based TransRec in terms of where and how to insert these adapters? Finally, we look at the effects of adapter-based TransRec by either scaling up its source training data or scaling down its target training data. Our paper provides key insights and practical guidance on unified & transferable recommendation -- a less studied recommendation scenario. We release our codes and other materials at: https://github.com/westlake-repl/Adapter4Rec/.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation

    cs.IR 2025-01 conditional novelty 6.0 of 10

    ReLLaX combines semantic behavior retrieval, collaborative soft prompts, and a new fully interactive LoRA variant to improve LLM-based CTR prediction on long user histories.

Pith tools