TY - JOUR
T1 - Data-Based Collaborative Learning for Multiagent Systems Under Distributed Denial-of-Service Attacks
AU - Xu, Yong
AU - Wu, Zheng Guang
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2024/2/1
Y1 - 2024/2/1
N2 - This article employs a reinforcement learning (RL) technique to investigate the distributed output tracking control of heterogeneous multiagent systems (MASs) under multiple Denial-of-Service (DoS) attacks. Different from existing results where the dynamic of the leader is known for partial or all agents, the leader's system matrix is completely unknown for each follower in this article. To learn the leader system matrix, a data-based learning mechanism is first proposed using the idea of the data-driven method. Then, under the data-based learning mechanism, a resilient predictor subject to multiple DoS attacks is exploited to provide the estimation of the leader's state for each agent, where adversaries attack different communication links independently. Moreover, a resilient dynamic output feedback controller is proposed to solve the output tracking control problem based on the output regulation theory. To consider the transient responses of agents, an RL-based dynamic output feedback controller is developed to realize the optimal output tracking control by solving discounted algebraic Riccati equations (AREs) in both offline and online ways. Theoretical analysis shows that the secure output tracking control of MASs can be achieved under the proposed data-based resilient learning control algorithm. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.
AB - This article employs a reinforcement learning (RL) technique to investigate the distributed output tracking control of heterogeneous multiagent systems (MASs) under multiple Denial-of-Service (DoS) attacks. Different from existing results where the dynamic of the leader is known for partial or all agents, the leader's system matrix is completely unknown for each follower in this article. To learn the leader system matrix, a data-based learning mechanism is first proposed using the idea of the data-driven method. Then, under the data-based learning mechanism, a resilient predictor subject to multiple DoS attacks is exploited to provide the estimation of the leader's state for each agent, where adversaries attack different communication links independently. Moreover, a resilient dynamic output feedback controller is proposed to solve the output tracking control problem based on the output regulation theory. To consider the transient responses of agents, an RL-based dynamic output feedback controller is developed to realize the optimal output tracking control by solving discounted algebraic Riccati equations (AREs) in both offline and online ways. Theoretical analysis shows that the secure output tracking control of MASs can be achieved under the proposed data-based resilient learning control algorithm. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.
KW - Denial-of-Service (DoS) attacks
KW - multiagent systems (MASs)
KW - reinforcement learning (RL)
KW - tracking control
UR - http://www.scopus.com/inward/record.url?scp=85132526737&partnerID=8YFLogxK
U2 - 10.1109/TCDS.2022.3172937
DO - 10.1109/TCDS.2022.3172937
M3 - Article
AN - SCOPUS:85132526737
SN - 2379-8920
VL - 16
SP - 75
EP - 85
JO - IEEE Transactions on Cognitive and Developmental Systems
JF - IEEE Transactions on Cognitive and Developmental Systems
IS - 1
ER -