Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Combining graph neural network with deep reinforcement learning for resource allocation in computing force networks

Abstract: Fueled by the explosive growth of ultra-low-latency and real-time applications with specific computing and network performance requirements, the computing force network (CFN) has become a hot research subject. The primary CFN challenge is to leverage network resources and computing resources. Although recent advances in deep reinforcement learning (DRL) have brought significant improvement in network optimization, these methods still suffer from topology changes and fail to generalize for those topologies not seen in training. This paper proposes a graph neural network (GNN) based DRL framework to accommodate network traffic and computing resources jointly and efficiently. By taking advantage of the generalization capability in GNN, the proposed method can operate over variable topologies and obtain higher performance than the other DRL methods.

Key words: Computing force network; Routing optimization; Deep learning; Graph neural network; Resource allocation

Chinese Summary  <1> 图神经网络与深度强化学习结合的算力网络资源分配方法

韩雪莹1,谢明熹2,禹可2,黄小红1,杜宗鹏3,姚惠娟3
1北京邮电大学计算机学院(国家示范性软件学院),中国北京市,100876
2北京邮电大学人工智能学院,中国北京市,100876
3中国移动研究院基础网络技术研究所,中国北京市,100032
摘要:由于具有特定计算需求及超低延迟传输需求的实时应用呈现爆炸性增长,算力网络成为热门研究课题。当前算力网络的主要挑战是如何权衡网络资源与计算资源,作出联合最优决策。尽管近年来深度强化学习在网络优化方面取得一定进步,但这些方法仍然受到拓扑结构变化的影响,特别是对未在训练中出现的网络拓扑作出决策。本文提出一个基于图神经网络的深度强化学习框架,使得智能体在进行网络与计算资源联合优化的同时,兼具拓扑泛化性,更加适应网络拓扑的动态变化。借助图神经网络的泛化优势,该方法可在变动的网络拓扑中运行,且相比基于传统深度强化学习的方法具有更强的优化决策能力。

关键词组:算力网络;路由优化;深度学习;图神经网络;资源分配


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2300009

CLC number:

TP393

Download Full Text:

Click Here

Downloaded:

838

Download summary:

<Click Here> 

Downloaded:

39

Clicked:

1014

Cited:

0

On-line Access:

2024-06-04

Received:

2023-01-05

Revision Accepted:

2024-06-04

Crosschecked:

2023-04-24

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE