REVIEW 4 cited by
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
For industrial-scale advertising systems, prediction of ad click-through rate (CTR) is a central problem. Ad clicks constitute a significant class of user engagements and are often used as the primary signal for the usefulness of ads to users. Additionally, in cost-per-click advertising systems where advertisers are charged per click, click rate expectations feed directly into value estimation. Accordingly, CTR model development is a significant investment for most Internet advertising companies. Engineering for such problems requires many machine learning (ML) techniques suited to online learning that go well beyond traditional accuracy improvements, especially concerning efficiency, reproducibility, calibration, credit attribution. We present a case study of practical techniques deployed in Google's search ads CTR model. This paper provides an industry case study highlighting important areas of current ML research and illustrating how impactful new ML methods are evaluated and made useful in a large-scale industrial setting.
Forward citations
Cited by 4 Pith papers
-
Taming the One-Epoch Phenomenon in Online Recommendation System by Two-stage Contrastive ID Pre-training
Pre-training ID embeddings with contrastive loss in a simple model avoids one-epoch overfitting and improves Pinterest's recommendation engagement by 2.2%.
-
Powering Job Search at Scale: LLM-Enhanced Query Understanding in Job Matching Systems
A single fine-tuned 1.5B LLM can replace multiple NER-based query understanding models in a job search engine, with measured gains in relevance and lower operational overhead.
-
Scalable Machine Learning Training Infrastructure for Online Ads Recommendation and Auction Scoring Modeling at Google
A production-scale TPU training stack for Google Ads models combines shared input memoization, hybrid embedding partitioning, pipelining, RPC coalescing, and preemption holds to improve training throughput by 116% and...
-
Beyond Self-Consistency: Loss-Balanced Perturbation-Based Regularization Improves Industrial-Scale Ads Ranking
Adding low-weight noisy copies of training examples improves Meta's ads ranking by about 0.1% to 0.3% relative Normalized Entropy, and slightly outperforms self-consistency regularization.
Discussion (0). Continue with ORCID to comment.