AdaOper: Energy-efficient and Responsive Concurrent DNN Inference on Mobile Devices

Bin Guo; Sicong Liu; Wentao Zhou; Yasan Ding; Yu Zhang; Zheng Lin; Zhiwen Yu

AdaOper: Energy-efficient and Responsive Concurrent DNN Inference on Mobile Devices

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.19209 v1 pith:GCWXH7JY submitted 2024-04-30 cs.DC

AdaOper: Energy-efficient and Responsive Concurrent DNN Inference on Mobile Devices

Zheng Lin , Bin Guo , Sicong Liu , Wentao Zhou , Yasan Ding , Yu Zhang , Zhiwen Yu This is my paper

classification cs.DC

keywords energymobileadaoperefficiencyconcurrentdevicesprocessorsapplications

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

Deep neural network (DNN) has driven extensive applications in mobile technology. However, for long-running mobile apps like voice assistants or video applications on smartphones, energy efficiency is critical for battery-powered devices. The rise of heterogeneous processors in mobile devices today has introduced new challenges for optimizing energy efficiency. Our key insight is that partitioning computations across different processors for parallelism and speedup doesn't necessarily correlate with energy consumption optimization and may even increase it. To address this, we present AdaOper, an energy-efficient concurrent DNN inference system. It optimizes energy efficiency on mobile heterogeneous processors while maintaining responsiveness. AdaOper includes a runtime energy profiler that dynamically adjusts operator partitioning to optimize energy efficiency based on dynamic device conditions. We conduct preliminary experiments, which show that AdaOper reduces energy consumption by 16.88% compared to the existing concurrent method while ensuring real-time performance.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Mitigating Compiler Fusion-Induced Power Bursts in Mobile NPU Inference as the Battery Depletes
cs.AR 2026-07 conditional novelty 6.0

Compiler fusion in a mobile NPU creates current bursts that raise the DVFS-onset voltage; measurement-guided Q-DQ barrier insertion cuts peak current from 3.12 A to 1.94 A (38%) with 3.76% latency overhead.