REVIEW 6 cited by
MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Mask
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Click-Through Rate(CTR) estimation has become one of the most fundamental tasks in many real-world applications and it's important for ranking models to effectively capture complex high-order features. Shallow feed-forward network is widely used in many state-of-the-art DNN models such as FNN, DeepFM and xDeepFM to implicitly capture high-order feature interactions. However, some research has proved that addictive feature interaction, particular feed-forward neural networks, is inefficient in capturing common feature interaction. To resolve this problem, we introduce specific multiplicative operation into DNN ranking system by proposing instance-guided mask which performs element-wise product both on the feature embedding and feed-forward layers guided by input instance. We also turn the feed-forward layer in DNN model into a mixture of addictive and multiplicative feature interactions by proposing MaskBlock in this paper. MaskBlock combines the layer normalization, instance-guided mask, and feed-forward layer and it is a basic building block to be used to design new ranking model under various configurations. The model consisting of MaskBlock is called MaskNet in this paper and two new MaskNet models are proposed to show the effectiveness of MaskBlock as basic building block for composing high performance ranking systems. The experiment results on three real-world datasets demonstrate that our proposed MaskNet models outperform state-of-the-art models such as DeepFM and xDeepFM significantly, which implies MaskBlock is an effective basic building unit for composing new high performance ranking systems.
Forward citations
Cited by 6 Pith papers
-
SpecFormer: Mitigating Embedding and Attention Collapse via Spectral-Aware Transformer for Recommendation
SpecFormer is a spectral-aware Transformer that flattens the singular-value spectrum of embeddings to prevent embedding/attention collapse, outperforming baselines on CTR benchmarks and scaling with layer depth.
-
Revisiting Feature Interactions from the Perspective of Quadratic Neural Networks for Click-through Rate Prediction
Hadamard product feature interactions work because they make CTR models quadratic networks, and the proposed QNN-alpha with multi-head Khatri-Rao product and self-ensemble loss achieves state-of-the-art results on six...
-
RAMP: Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways
RAMP splits ad prediction into personalized and non-personalized towers, then uses a distillation-style loss to transfer knowledge so non-personalized predictions stay accurate when user features are absent.
-
Synergizing Implicit and Explicit User Interests: A Multi-Embedding Retrieval Framework at Pinterest
A production recommender framework combines a differentiable clustering module for implicit interests and conditional retrieval for explicit followed topics, deployed at Pinterest home feed.
-
Breaker: Removing Shortcut Cues with User Clustering for Single-slot Recommendation System
Breaker improves single-slot recommendation by clustering users into groups, which makes the model work harder on user-side features and focus more on user-item preferences.
-
Decoupled Entity Representation Learning for Pinterest Ads Ranking
Pre-computed user and Pin embeddings from multi-tower models improve Pinterest ad ranking by small but statistically significant margins.
Discussion (0). Continue with ORCID to comment.