Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Federated deep reinforcement learning based computation offloading in a low Earth orbit satellite edge computing system

Abstract: Recent studies have shown that system capacity is very important for cellular networks. In this paper, we consider maximizing the weighted sum-rate of the cellular network downlink and uplink, where each cell consists of a full-duplex (FD) base station (BS) and half-duplex (HD) users. Federated learning (FL) can train models in the absence of centralized data, which can achieve privacy protection of user data. A low Earth orbit (LEO) satellite edge computing system (LSECS) can be formed by placing the mobile edge computing (MEC) servers on LEO satellites, which greatly increases the processing capacities of the satellites. Therefore, we consider a combination of FL and MEC and propose an FL-based computation offloading algorithm to maximize the weighted sum-rate while ensuring the security of user data. We consider solving the sub-channel assignment and power allocation problems using deep reinforcement learning (DRL) algorithms with excellent global search capabilities. The simulation results show that our proposed algorithm achieves the maximum weighted sum-rate compared with the baseline algorithms and excellent convergence.

Key words: Federated learning; Low Earth orbit satellite; Mobile edge computing; Deep reinforcement learning; Computation offloading

Chinese Summary  <1> 基于联邦深度强化学习的低轨卫星边缘计算系统计算卸载

贾敏,吴健,王欣玉,郭庆
哈尔滨工业大学电子与信息工程学院,中国哈尔滨市,150006
摘要:最近研究表明系统容量对蜂窝网络非常重要。本文考虑最大化蜂窝网络下行链路和上行链路的加权和速率,其中每个小区由一个全双工基站和半双工用户组成。联邦学习可以在没有集中数据的情况下训练模型,实现对用户数据的隐私保护。将移动边缘计算服务器放置在低轨卫星上,可形成低轨卫星边缘计算系统,大大提高卫星的处理能力。因此,本文将联邦学习和移动边缘计算结合,提出一种基于联邦学习的计算卸载算法,在保证用户数据安全的同时最大化加权和速率。采用具有出色全局搜索能力的深度强化学习算法解决子信道分配和功率分配问题。仿真结果表明,与基准算法相比,该算法实现了最大的加权和速率,并具有良好收敛性能。

关键词组:联邦学习;低轨卫星;移动边缘计算;深度强化学习;计算卸载


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2400448

CLC number:

TN929.5

Download Full Text:

Click Here

Downloaded:

530

Clicked:

451

Cited:

0

On-line Access:

2025-06-04

Received:

2024-05-28

Revision Accepted:

2024-10-15

Crosschecked:

2025-06-04

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE