REVIEW 11 cited by
QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishou
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
In recent years, with the significant evolution of multi-modal large models, many recommender researchers realized the potential of multi-modal information for user interest modeling. In industry, a wide-used modeling architecture is a cascading paradigm: (1) first pre-training a multi-modal model to provide omnipotent representations for downstream services; (2) The downstream recommendation model takes the multi-modal representation as additional input to fit real user-item behaviours. Although such paradigm achieves remarkable improvements, however, there still exist two problems that limit model performance: (1) Representation Unmatching: The pre-trained multi-modal model is always supervised by the classic NLP/CV tasks, while the recommendation models are supervised by real user-item interaction. As a result, the two fundamentally different tasks' goals were relatively separate, and there was a lack of consistent objective on their representations; (2) Representation Unlearning: The generated multi-modal representations are always stored in cache store and serve as extra fixed input of recommendation model, thus could not be updated by recommendation model gradient, further unfriendly for downstream training. Inspired by the two difficulties challenges in downstream tasks usage, we introduce a quantitative multi-modal framework to customize the specialized and trainable multi-modal information for different downstream models.
Forward citations
Cited by 11 Pith papers
-
Understanding Generative Recommendation with Semantic IDs from a Model-scaling View
Semantic-ID-based generative recommenders saturate as model size grows, while directly using an LLM as the recommender keeps improving with scale and learns collaborative filtering signals better.
-
Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs
MME-SID improves LLM-based sequential recommendation by fusing collaborative, text, and image embeddings with quantized semantic IDs, using MMD reconstruction and code-embedding initialization.
-
Generative Recommendation with Semantic IDs: A Practitioner's Handbook
An open-source framework and ablation study showing which semantic-ID generative recommendation components actually matter, with results that challenge several standard defaults.
-
VRAgent-R1: Boosting Video Recommendation with MLLM-based Agents via Reinforcement Learning
VRAgent-R1 uses an MLLM agent to summarize videos and a reinforcement-learned agent to simulate user choices, improving video recommendation and user-decision simulation on MicroLens-100K.
-
OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestion
A unified encoder-decoder model with prefix representation enhancement and reward-weighted DPO outperforms Kuaishou's online multi-stage query suggestion system in offline and live A/B evaluations.
-
EGA-V1: Unifying Online Advertising with End-to-End Learning
EGA-V1 unifies advertising ranking and auction into a single non-autoregressive generative model with cluster attention, and is reported to beat multi-stage cascades on Meituan's ad traffic.
-
Diffusion-based Multi-modal Synergy Interest Network for Click-through Rate Prediction
Diff-MSIN improves multi-modal CTR prediction AUC by roughly 1.5-2% over prior multi-modal baselines by disentangling common, specific, and synergistic modality features.
-
MISS: Multi-Modal Tree Indexing and Searching with Lifelong Sequential Behavior for Retrieval Recommendation
MISS builds a k-means index tree on interaction-supervised multi-modal embeddings and adds two behavior search units (Co-GSU, MM-GSU) plus ESU/MMoE, reporting ~30-47% relative recall gains over TDM+MMoE on Kuaishou da...
-
Dynamic Content Moderation in Livestreams: Combining Supervised Classification with MLLM-Boosted Similarity Matching
A deployed hybrid moderation system combining supervised classification and reference-based similarity matching, boosted by MLLM distillation, reduces unwanted livestream views by 6–8%.
-
FARM: Frequency-Aware Model for Cross-Domain Live-Streaming Recommendation
FARM combines discrete Fourier frequency splitting with contrastive preference alignment to improve cross-domain live-streaming recommendation at Kuaishou.
-
GR-LLMs: Recent Advances in Generative Recommendation Based on Large Language Models
A survey of LLM-based generative recommendation systems, covering application settings, training pipelines, industrial deployment challenges, and future directions.
Discussion (0). Continue with ORCID to comment.