|
|
Frontiers of Information Technology & Electronic Engineering
ISSN 2095-9184 (print), ISSN 2095-9230 (online)
2022 Vol.23 No.7 P.1010-1019
Optimal synchronization control for multi-agent systems with input saturation: a nonzero-sum game
Abstract: This paper presents a novel optimal synchronization control method for multi-agent systems with input saturation. The multi-agent game theory is introduced to transform the optimal synchronization control problem into a multi-agent nonzero-sum game. Then, the Nash equilibrium can be achieved by solving the coupled Hamilton–Jacobi–Bellman (HJB) equations with nonquadratic input energy terms. A novel off-policy reinforcement learning method is presented to obtain the Nash equilibrium solution without the system models, and the critic neural networks (NNs) and actor NNs are introduced to implement the presented method. Theoretical analysis is provided, which shows that the iterative control laws converge to the Nash equilibrium. Simulation results show the good performance of the presented method.
Key words: Optimal synchronization control; Multi-agent systems; Nonzero-sum game; Adaptive dynamic programming; Input saturation; Off-policy reinforcement learning; Policy iteration
1中国科学院大学人工智能学院，中国北京市，100049
2中国科学院自动化研究所复杂系统管理与控制国家重点实验室，中国北京市，100190
3澳门科技大学系统工程研究所，中国澳门特别行政区，999078
摘要：本文针对输入饱和下的多智能体系统，提出一种最优一致性控制方法。引入多智能体博弈理论，将最优一致性控制问题转化为多智能体非零和博弈。之后，通过求解具有非二次输入能量项的耦合Hamilton–Jacobi–Bellman（HJB）方程，实现Nash平衡。提出脱策强化学习方法，在系统模型未知情况下获得Nash平衡解；引入评判神经网络和执行神经网络实现所提方法。理论分析显示迭代控制律收敛到Nash平衡。仿真实验验证了所提方法的有效性。
关键词组：
References:
Open peer comments: Debate/Discuss/Question/Opinion
<1>
DOI:
10.1631/FITEE.2200010
CLC number:
TP13
Download Full Text:
Downloaded:
6393
Download summary:
<Click Here>Downloaded:
329Clicked:
2221
Cited:
0
On-line Access:
2022-07-21
Received:
2022-01-14
Revision Accepted:
2022-07-21
Crosschecked:
2022-03-07