Pith. sign in

REVIEW 9 cited by

Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2309.16739 v4 pith:7REVKYVF submitted 2023-09-28 cs.LG cs.AI

Zheng Lin , Guanqiao Qu , Qiyuan Chen , Xianhao Chen , Zhe Chen , Kaibin Huang This is my paper
classification cs.LGcs.AI
keywords edgellmschallengesdeploymentinferencearticleaspectscritical
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical challenges: 1) long response time; 2) high bandwidth costs; and 3) the violation of data privacy. 6G mobile edge computing (MEC) systems may resolve these pressing issues. In this article, we explore the potential of deploying LLMs at the 6G edge. We start by introducing killer applications powered by multimodal LLMs, including robotics and healthcare, to highlight the need for deploying LLMs in the vicinity of end users. Then, we identify the critical challenges for LLM deployment at the edge and envision the 6G MEC architecture for LLMs. Furthermore, we delve into two design aspects, i.e., edge training and edge inference for LLMs. In both aspects, considering the inherent resource limitations at the edge, we discuss various cutting-edge techniques, including split learning/inference, parameter-efficient fine-tuning, quantization, and parameter-sharing inference, to facilitate the efficient deployment of LLMs. This article serves as a position paper for thoroughly identifying the motivation, challenges, and pathway for empowering LLMs at the 6G edge.

Discussion (0). Sign in to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoring

    cs.NI 2025-08 unverdicted novelty 6.0 of 10

    DUAL-Health is an uncertainty-aware multimodal fusion framework that quantifies sensor noise, customizes fusion weights accordingly, and aligns modality distributions to improve outdoor health monitoring.

  2. RRTO: A High-Performance Transparent Offloading System for Model Inference in Mobile Edge Computing

    cs.NI 2025-07 conditional novelty 6.0 of 10

    RRTO identifies static inference operator sequences from CUDA call logs alone and replays them on an edge GPU, cutting transparent-offloading communication to 11 RPCs per inference instead of thousands, with performan...

  3. AIC-VDS: Attention-Based In-Context Learning for Joint Velocity Control and Data Collection Scheduling in Multi-UAV-Assisted Pipeline Monitoring

    cs.AI 2025-10 reject novelty 5.0 of 10

    AIC-VDS uses trainable attention to shrink sensor data prompts for an LLM, and simulations show lower packet loss than two baselines in multi-UAV monitoring.

  4. PHandover: Parallel Handover in Mobile Satellite Network

    cs.NI 2025-07 conditional novelty 5.0 of 10

    A parallel, plan-based handover using a new Satellite Synchronized Function cuts LEO satellite handover latency to about 9 ms on average in an emulated prototype.

  5. Prompting Wireless Networks: Reinforced In-Context Learning for Power Control

    eess.SP 2025-06 conditional novelty 5.0 of 10

    Prompting LLMs with a few reward-ranked state-action examples controls base station power at a level comparable to a trained DQN on a small simulated problem.

  6. Joint Partitioning and Placement of Foundation Models for Real-Time Edge AI

    cs.DC 2025-11 reject novelty 4.0 of 10

    A framework for runtime re-splitting and re-placement of foundation model layers across edge nodes is proposed, but its claimed latency gains are inherited from prior work rather than measured.

  7. Energy-Efficient Wireless LLM Inference via Uncertainty and Importance-Aware Speculative Decoding

    cs.LG 2025-08 reject novelty 4.0 of 10

    This paper proposes filtering cloud-verification requests by combining token-level uncertainty with attention-based importance, claiming energy savings up to 40.7% in wireless hybrid LLM inference.

  8. Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration

    cs.NI 2025-07 conditional novelty 4.0 of 10

    A survey of multi-LLM systems in edge computing, covering architectures, enabling technologies, trust mechanisms, applications, and open datasets for edge general intelligence.

  9. White paper: Towards Human-centric and Sustainable 6G Services -- the fortiss Research Perspective

    cs.NI 2025-07 unverdicted

    A research institute's white paper restating known 6G trends; no new technical results or measurements are presented.

Pith tools