Deep Reinforcement Learning-Based Multi-constraint Guidance with Field-of-View Limitation

Yuhui Pu, Yuru Bin, Hui Wang*, Haorui Yang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The advancement of deep reinforcement learning (DRL) algorithms has created new avenues to solve multi-constraint problems. Typically, multi-constraint advice entails maximizing the intended goal while taking into account several restrictions. The guidance module is able to optimize the guidance command in real time by acting as an intelligent entity that is capable of gathering information and input from its surroundings. In this paper, we develop a multi-stage guiding architecture using the prediction and correction concept as our foundation. This study decouples the guidance law to realize the impact angle constraints in the first stage. In the second step, we fitted a predictor to estimate the flight’s time-to-go. Additionally, by adjusting the bias term of the proportional navigation guidance law, we set a corrector to control the impact time and angle. Subsequently, we select a nonlinear optimization function in order to restrict the field-of-view. The study offers a technique for producing the multi-constraint guidance command using DRL.

Original languageEnglish
Title of host publicationAdvances in Guidance, Navigation and Control - Proceedings of 2024 International Conference on Guidance, Navigation and Control Volume 5
EditorsLiang Yan, Haibin Duan, Yimin Deng
PublisherSpringer Science and Business Media Deutschland GmbH
Pages54-63
Number of pages10
ISBN (Print)9789819622153
DOIs
Publication statusPublished - 2025
EventInternational Conference on Guidance, Navigation and Control, ICGNC 2024 - Changsha, China
Duration: 9 Aug 202411 Aug 2024

Publication series

NameLecture Notes in Electrical Engineering
Volume1341 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

ConferenceInternational Conference on Guidance, Navigation and Control, ICGNC 2024
Country/TerritoryChina
CityChangsha
Period9/08/2411/08/24

Keywords

  • Deep reinforcement learning (DRL)
  • Field-of-view limitation
  • Multi-constraint guidance
  • Prediction and correction

Fingerprint

Dive into the research topics of 'Deep Reinforcement Learning-Based Multi-constraint Guidance with Field-of-View Limitation'. Together they form a unique fingerprint.

Cite this