基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法

陈宇轩; 李荣鹏; 于小雪; 赵志峰; 张宏纲

doi:10.1631/FITEE.2400468

Your Location：

Home >

Browse articles >

基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法

专辑 | Updated：2025-03-13

- 基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法
  Enhanced Publication
- Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach
- “在边缘计算领域，本研究引入了一种受基于模型的强化学习启发的框架，以优化大型语言模型的部署，显著降低计算成本，并在各种网络条件下平衡推理性能和计算负载。”
- 信息与电子工程前沿（英文） 2025年26卷第2期页码：278-292
- Affiliations：
  
  1.College of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310027, China
  2.Zhejiang Lab, Hangzhou 310012, China
- Author bio：
  
  E-mail: cyx00@zju.edu.cn
  ‡Corresponding author
  sdwhyxx@zju.edu.cn
  zhaozf@zhejianglab.com
  honggangzhang@zju.edu.cn
- Funds：
  
  the National Key Research and Development Program of China(2024YFE0200600);National Natural Science Foundation of China(62071425);Zhejiang Key Research and Development Plan, China(2022C01093);Zhejiang Provincial Natural Science Foundation of China(LR23F010005);National Key Laboratory of Wireless Communications Foundation, China(2023KP01601);Big Data and Intelligent Computing Key Lab of CQUPT, China(BDIC-2023-B-001)
- DOI：10.1631/FITEE.2400468
  中图分类号： TP391
- 收稿日期：2024-06-01，
  
  修回日期：2024-09-13，
  
  纸质出版日期：2025-02
- Accepted：
Scan QR Code
陈宇轩, 李荣鹏, 于小雪, 等. 基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法[J]. 信息与电子工程前沿（英文）, 2025,26(2):278-292.

Yuxuan CHEN, Rongpeng LI, Xiaoxue YU, et al. Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach[J]. Frontiers of information technology & electronic engineering, 2025, 26(2): 278-292.
陈宇轩, 李荣鹏, 于小雪, 等. 基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法[J]. 信息与电子工程前沿（英文）, 2025,26(2):278-292. DOI： 10.1631/FITEE.2400468.

Yuxuan CHEN, Rongpeng LI, Xiaoxue YU, et al. Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach[J]. Frontiers of information technology & electronic engineering, 2025, 26(2): 278-292. DOI： 10.1631/FITEE.2400468.

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

A cloud-edge-device collaborative offloading scheme with heterogeneous tasks and its performance evaluation

EdgeKeeper: a trusted edge computing framework for ubiquitous power Internet of Things

Cost-effective resource segmentation in hierarchical mobile edge clouds

基于模型强化学习的边缘计算无线大语言模型推理自适应层切分方法

Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach

DOI：10.1631/FITEE.2400468