TY - JOUR
T1 - Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks
T2 - A Reinforcement Learning Approach
AU - Xu, Yong
AU - Wu, Zheng Guang
AU - Pan, Ya Jun
N1 - Publisher Copyright:
© 1967-2012 IEEE.
PY - 2023/11/1
Y1 - 2023/11/1
N2 - This paper considers the distributed optimal path tracking control problem of autonomous ground vehicles (AGVs) with matched uncertainties under denial-of-service (DoS) attacks. First, to solve the uncertain system parameters, an inverse reinforcement learning (RL) technique is PROPOSED to seek the optimal controller instead of directly solving the robust control problem, which can ensure that the designed controller is globally optimal with respect to the proposal performance function. An off-policy RL algorithm is further proposed to learn the optimal control solution online without requiring any knowledge of the vehicle dynamics. Then, to lower the communication load among vehicles, a perception-based optimal resilient controller and its corresponding perception-based static deadband condition are developed, respectively. Moreover, the perception-based dynamic deadband control mechanism is further exploited to consider the secure path tracking control problem. The proposed algorithms verify that the RL-based optimal path tracking control can be solved, and the occurrence of the Zeno phenomenon can be avoided. Finally, a numerical simulation is demonstrated to verify the effectiveness of the proposed approach.
AB - This paper considers the distributed optimal path tracking control problem of autonomous ground vehicles (AGVs) with matched uncertainties under denial-of-service (DoS) attacks. First, to solve the uncertain system parameters, an inverse reinforcement learning (RL) technique is PROPOSED to seek the optimal controller instead of directly solving the robust control problem, which can ensure that the designed controller is globally optimal with respect to the proposal performance function. An off-policy RL algorithm is further proposed to learn the optimal control solution online without requiring any knowledge of the vehicle dynamics. Then, to lower the communication load among vehicles, a perception-based optimal resilient controller and its corresponding perception-based static deadband condition are developed, respectively. Moreover, the perception-based dynamic deadband control mechanism is further exploited to consider the secure path tracking control problem. The proposed algorithms verify that the RL-based optimal path tracking control can be solved, and the occurrence of the Zeno phenomenon can be avoided. Finally, a numerical simulation is demonstrated to verify the effectiveness of the proposed approach.
KW - Autonomous ground vehicles (AGVs)
KW - DoS attacks
KW - Path tracking control
KW - Reinforcement learning (RL)
KW - Robust control
UR - http://www.scopus.com/inward/record.url?scp=85162897678&partnerID=8YFLogxK
U2 - 10.1109/TVT.2023.3287272
DO - 10.1109/TVT.2023.3287272
M3 - Article
AN - SCOPUS:85162897678
SN - 0018-9545
VL - 72
SP - 14028
EP - 14039
JO - IEEE Transactions on Vehicular Technology
JF - IEEE Transactions on Vehicular Technology
IS - 11
ER -