REVIEW 4 cited by
MARM: Unlocking the Future of Recommendation Systems through Memory Augmentation and Scalable Complexity
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Scaling-law has guided the language model designing for past years, however, it is worth noting that the scaling laws of NLP cannot be directly applied to RecSys due to the following reasons: (1) The amount of training samples and model parameters is typically not the bottleneck for the model. Our recommendation system can generate over 50 billion user samples daily, and such a massive amount of training data can easily allow our model parameters to exceed 200 billion, surpassing many LLMs (about 100B). (2) To ensure the stability and robustness of the recommendation system, it is essential to control computational complexity FLOPs carefully. Considering the above differences with LLM, we can draw a conclusion that: for a RecSys model, compared to model parameters, the computational complexity FLOPs is a more expensive factor that requires careful control. In this paper, we propose our milestone work, MARM (Memory Augmented Recommendation Model), which explores a new cache scaling-laws successfully.
Forward citations
Cited by 4 Pith papers
-
CAPTS: Channel-Aware, Preference-Aligned Trigger Selection for Multi-Channel Item-to-Item Retrieval
CAPTS selects retrieval triggers by predicted downstream engagement per I2I channel and routes them jointly, reporting offline Recall@K gains and a small online time-spent lift.
-
Request-Only Optimization for Recommendation Systems
A request-level training data format eliminates duplicate user features, increasing storage efficiency and training throughput while enabling larger recommendation architectures.
-
A Contextual-Aware Position Encoding for Sequential Recommendation
CAPE computes context-dependent positions from item dissimilarity and fuses them into attention, improving sequential recommenders on benchmark and live-traffic tests.
-
Climber: Toward Efficient Scaling Laws for Large Recommendation Models
Climber reports that splitting user sequences by behavior type, adding adaptive temperature, and co-designed batching enable more efficient Transformer scaling in recommender systems.
Discussion (0). Continue with ORCID to comment.