Feature Hashing for Large Scale Multitask Learning
read the original abstract
Empirical evidence suggests that hashing is an effective strategy for dimensionality reduction and practical nonparametric estimation. In this paper we provide exponential tail bounds for feature hashing and show that the interaction between random subspaces is negligible with high probability. We demonstrate the feasibility of this approach with experimental results for a new use case -- multitask learning with hundreds of thousands of tasks.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Sketching the Readout of Large Language Models for Scalable Data Attribution and Valuation
RISE applies CountSketch to dual lexical and semantic channels derived from output-layer gradient outer products, cutting data attribution storage by up to 112x and enabling retrospective and prospective influence ana...
-
Applying Graph Analysis for Unsupervised Fast Malware Fingerprinting
TrapNet applies PCA-based FloatHash vectors and graph community detection to enable unsupervised malware fingerprinting and family attribution from static analysis.
-
Semantic Product Search
A neural semantic matcher for product search uses a custom loss on behavior data, n-gram pooling, and hashing to beat prior methods by 4.7% Recall@100 and 14.5% MAP.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.