Analytical bounds demonstrate edge-cloud DSD improves latency only in low-RTT regimes and primarily benefits multi-tenant throughput via draft offloading under client overlap.
A pipelined collaborative speculative decoding framework for efficient edge-cloud llm inference,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DC 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Speculation at a Distance: Where Edge-Cloud Speculative Decoding Actually Pays Off
Analytical bounds demonstrate edge-cloud DSD improves latency only in low-RTT regimes and primarily benefits multi-tenant throughput via draft offloading under client overlap.