Delayed Soft Actor-Critic Based Path Planning Method for UAV in Dense Obstacles Environment

Jianxin Zhong, Teng Long, JingLiang Sun, Junzhi Li, Yan Cao

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In order to improve the convergence performance of soft actor-critic (SAC) algorithm in path planning problems, a delayed prioritized experience replay soft actor critic (DPERSAC) is proposed by designing a novel experience replay mechanism in a non-uniform manner for decreasing the convergence time. The path planning mathematical model is built for unmanned aerial vehicles (UAVs) subject to the flight performance constraints and obstacle avoidance constraints. Then the three typical elements of SAC are customized to satisfy the requirements of UAV's path planning. Differ from the traditional update manner that the soft Q-function network and policy network are updated recursively, the soft Q-function network is updated conditionally firstly and the policy network is subsequently iterated based on the trained soft Q-function in this paper. Finally, the Monte Carlo simulation results demonstrate that the computational time of the proposed DPERSAC method is only 4% of the rolling-based sparse A ∗ algorithm in the dense obstacle environment.

源语言英语
主期刊名2023 9th International Conference on Control Science and Systems Engineering, ICCSSE 2023
出版商Institute of Electrical and Electronics Engineers Inc.
172-177
页数6
ISBN(电子版)9798350339055
DOI
出版状态已出版 - 2023
活动9th International Conference on Control Science and Systems Engineering, ICCSSE 2023 - Shenzhen, 中国
期限: 16 6月 202318 6月 2023

出版系列

姓名2023 9th International Conference on Control Science and Systems Engineering, ICCSSE 2023

会议

会议9th International Conference on Control Science and Systems Engineering, ICCSSE 2023
国家/地区中国
Shenzhen
时期16/06/2318/06/23

指纹

探究 'Delayed Soft Actor-Critic Based Path Planning Method for UAV in Dense Obstacles Environment' 的科研主题。它们共同构成独一无二的指纹。

引用此