Fast Vocabulary Transfer for Language Model Compression
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:FPB3LXXFrecord.jsonopen to challenge →
classification
cs.CL
cs.AIcs.LG
keywords
modelcompressiontransfervocabularylanguagemethodperformancesize
read the original abstract
Real-world business applications require a trade-off between language model performance and size. We propose a new method for model compression that relies on vocabulary transfer. We evaluate the method on various vertical domains and downstream tasks. Our results indicate that vocabulary transfer can be effectively used in combination with other compression techniques, yielding a significant reduction in model size and inference time while marginally compromising on performance.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.