Disaggregated inference is modeled as three games whose price of anarchy rises at GPU saturation; an adaptive controller reduces the empirical PoA-hat by up to 3.1x on real clusters at modest throughput cost.
Serving long-context LLMs at the mobile edge: Test-time reinforcement learning-based model caching and inference offloading.arXiv preprint arXiv:2501.14205, 2025
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AR 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
The Price of Anarchy in Disaggregated Inference
Disaggregated inference is modeled as three games whose price of anarchy rises at GPU saturation; an adaptive controller reduces the empirical PoA-hat by up to 3.1x on real clusters at modest throughput cost.