An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Wei Zhang; Lei Lei; Lijuan Zhang

doi:10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Wei Zhang, Lei Lei, Lijuan Zhang^*

^*此作品的通讯作者

Nanjing University of Aeronautics and Astronautics

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

源语言	英语
主期刊名	Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology
编辑	Jian Dong, Long Zhang, Deqiang Cheng
出版商	Springer Science and Business Media Deutschland GmbH
页	81-89
页数	9
ISBN（印刷版）	9789819727568
DOI	https://doi.org/10.1007/978-981-97-2757-5_9
出版状态	已出版 - 2024
已对外发布	是
活动	2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023 - Xuzhou, 中国期限: 22 9月 2023 → 24 9月 2023

出版系列

姓名	Lecture Notes in Electrical Engineering
卷	1197
ISSN（印刷版）	1876-1100
ISSN（电子版）	1876-1119

会议

会议	2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023
国家/地区	中国
市	Xuzhou
时期	22/09/23 → 24/09/23

联合国可持续发展目标

此成果有助于实现下列可持续发展目标：

访问文件

10.1007/978-981-97-2757-5_9

其它文件与链接

链接到 Scopus 的出版物

引用此

Zhang, W., Lei, L., & Zhang, L. (2024). An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. 在 J. Dong, L. Zhang, & D. Cheng (编辑), Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology (页码 81-89). (Lecture Notes in Electrical Engineering; 卷 1197). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-97-2757-5_9

Zhang, Wei ; Lei, Lei ; Zhang, Lijuan. / An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. 编辑 / Jian Dong ; Long Zhang ; Deqiang Cheng. Springer Science and Business Media Deutschland GmbH, 2024. 页码 81-89 (Lecture Notes in Electrical Engineering).

@inproceedings{b9163a0d93b445569299083794ceebb8,

title = "An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm",

abstract = "This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.",

keywords = "3D coverage, connectivity, energy consumption, MADDPG, UAV",

author = "Wei Zhang and Lei Lei and Lijuan Zhang",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.; 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023 ; Conference date: 22-09-2023 Through 24-09-2023",

year = "2024",

doi = "10.1007/978-981-97-2757-5_9",

language = "English",

isbn = "9789819727568",

series = "Lecture Notes in Electrical Engineering",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "81--89",

editor = "Jian Dong and Long Zhang and Deqiang Cheng",

booktitle = "Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology",

address = "Germany",

}

Zhang, W, Lei, L & Zhang, L 2024, An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. 在 J Dong, L Zhang & D Cheng (编辑), Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. Lecture Notes in Electrical Engineering, 卷 1197, Springer Science and Business Media Deutschland GmbH, 页码 81-89, 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023, Xuzhou, 中国, 22/09/23. https://doi.org/10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. / Zhang, Wei; Lei, Lei; Zhang, Lijuan.
Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. 编辑 / Jian Dong; Long Zhang; Deqiang Cheng. Springer Science and Business Media Deutschland GmbH, 2024. 页码 81-89 (Lecture Notes in Electrical Engineering; 卷 1197).

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

TY - GEN

T1 - An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

AU - Zhang, Wei

AU - Lei, Lei

AU - Zhang, Lijuan

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

PY - 2024

Y1 - 2024

N2 - This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

AB - This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

KW - 3D coverage

KW - connectivity

KW - energy consumption

KW - MADDPG

KW - UAV

UR - http://www.scopus.com/inward/record.url?scp=85192481097&partnerID=8YFLogxK

U2 - 10.1007/978-981-97-2757-5_9

DO - 10.1007/978-981-97-2757-5_9

M3 - Conference contribution

AN - SCOPUS:85192481097

SN - 9789819727568

T3 - Lecture Notes in Electrical Engineering

SP - 81

EP - 89

BT - Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

A2 - Dong, Jian

A2 - Zhang, Long

A2 - Cheng, Deqiang

PB - Springer Science and Business Media Deutschland GmbH

T2 - 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023

Y2 - 22 September 2023 through 24 September 2023

ER -

Zhang W, Lei L, Zhang L. An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. 在 Dong J, Zhang L, Cheng D, 编辑, Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. Springer Science and Business Media Deutschland GmbH. 2024. 页码 81-89. (Lecture Notes in Electrical Engineering). doi: 10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

摘要

出版系列

会议

联合国可持续发展目标

访问文件

其它文件与链接

指纹

引用此