An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Wei Zhang; Lei Lei; Lijuan Zhang

doi:10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Wei Zhang
, Lei Lei
, Lijuan Zhang^*

^*Corresponding author for this work

Nanjing University of Aeronautics and Astronautics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

Original language	English
Title of host publication	Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology
Editors	Jian Dong, Long Zhang, Deqiang Cheng
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	81-89
Number of pages	9
ISBN (Print)	9789819727568
DOIs	https://doi.org/10.1007/978-981-97-2757-5_9
Publication status	Published - 2024
Externally published	Yes
Event	2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023 - Xuzhou, China Duration: 22 Sept 2023 → 24 Sept 2023

Publication series

Name	Lecture Notes in Electrical Engineering
Volume	1197
ISSN (Print)	1876-1100
ISSN (Electronic)	1876-1119

Conference

Conference	2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023
Country/Territory	China
City	Xuzhou
Period	22/09/23 → 24/09/23

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 7 Affordable and Clean Energy

Keywords

3D coverage
MADDPG
UAV
connectivity
energy consumption

Access to Document

10.1007/978-981-97-2757-5_9

Cite this

Zhang, W., Lei, L., & Zhang, L. (2024). An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. In J. Dong, L. Zhang, & D. Cheng (Eds.), Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology (pp. 81-89). (Lecture Notes in Electrical Engineering; Vol. 1197). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-97-2757-5_9

Zhang, Wei ; Lei, Lei ; Zhang, Lijuan. / An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. editor / Jian Dong ; Long Zhang ; Deqiang Cheng. Springer Science and Business Media Deutschland GmbH, 2024. pp. 81-89 (Lecture Notes in Electrical Engineering).

@inproceedings{b9163a0d93b445569299083794ceebb8,

title = "An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm",

abstract = "This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.",

keywords = "3D coverage, MADDPG, UAV, connectivity, energy consumption",

author = "Wei Zhang and Lei Lei and Lijuan Zhang",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.; 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023 ; Conference date: 22-09-2023 Through 24-09-2023",

year = "2024",

doi = "10.1007/978-981-97-2757-5\_9",

language = "English",

isbn = "9789819727568",

series = "Lecture Notes in Electrical Engineering",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "81--89",

editor = "Jian Dong and Long Zhang and Deqiang Cheng",

booktitle = "Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology",

address = "Germany",

}

Zhang, W, Lei, L & Zhang, L 2024, An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. in J Dong, L Zhang & D Cheng (eds), Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. Lecture Notes in Electrical Engineering, vol. 1197, Springer Science and Business Media Deutschland GmbH, pp. 81-89, 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023, Xuzhou, China, 22/09/23. https://doi.org/10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. / Zhang, Wei; Lei, Lei; Zhang, Lijuan.
Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. ed. / Jian Dong; Long Zhang; Deqiang Cheng. Springer Science and Business Media Deutschland GmbH, 2024. p. 81-89 (Lecture Notes in Electrical Engineering; Vol. 1197).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

AU - Zhang, Wei

AU - Lei, Lei

AU - Zhang, Lijuan

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

PY - 2024

Y1 - 2024

N2 - This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

AB - This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

KW - 3D coverage

KW - MADDPG

KW - UAV

KW - connectivity

KW - energy consumption

UR - https://www.scopus.com/pages/publications/85192481097

U2 - 10.1007/978-981-97-2757-5_9

DO - 10.1007/978-981-97-2757-5_9

M3 - Conference contribution

AN - SCOPUS:85192481097

SN - 9789819727568

T3 - Lecture Notes in Electrical Engineering

SP - 81

EP - 89

BT - Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

A2 - Dong, Jian

A2 - Zhang, Long

A2 - Cheng, Deqiang

PB - Springer Science and Business Media Deutschland GmbH

T2 - 2nd International Conference on Internet of Things, Communication and Intelligent Technology, IoTCIT 2023

Y2 - 22 September 2023 through 24 September 2023

ER -

Zhang W, Lei L, Zhang L. An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm. In Dong J, Zhang L, Cheng D, editors, Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. Springer Science and Business Media Deutschland GmbH. 2024. p. 81-89. (Lecture Notes in Electrical Engineering). doi: 10.1007/978-981-97-2757-5_9

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this