DSSD moves the resample step of speculative decoding onto the device, replacing the upload of many token distributions with a single download when a draft is rejected.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
eess.SP 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
DSSD: Efficient Edge-Device LLM Deployment and Collaborative Inference via Distributed Split Speculative Decoding
DSSD moves the resample step of speculative decoding onto the device, replacing the upload of many token distributions with a single download when a draft is rejected.