Abstract
The escalation of space confrontations has elevated orbital pursuit-evasion games to a prominent research area, with multi-spacecraft scenarios presenting critical challenges such as high-dimensional state modeling and solution complexity. This paper proposes a hierarchical decision-making framework based on task decoupling to overcome the bottlenecks of traditional differential games and multi-agent reinforcement learning. A global task allocation layer employs an enhanced genetic algorithm to optimize pursuit-evader matching, while a local dynamic control layer applies a Deep Deterministic Policy Gradient (DDPG) model to execute pursuit strategies. A closed-loop decision flow between the two layers is established, where global allocation delineates operational targets for local control, and local strategy feedback evaluates success rates to guide global optimization, thereby achieving stable decision-making under complex game scenarios. Simulation results in a multi-spacecraft scenario demonstrate a 97% pursuit success rate, validating the hierarchical structure's effectiveness in reducing dimensionality and enhancing performance.
| Original language | English |
|---|---|
| Pages (from-to) | 1782-1787 |
| Number of pages | 6 |
| Journal | IFAC-PapersOnLine |
| Volume | 59 |
| Issue number | 20 |
| DOIs | |
| Publication status | Published - 1 Aug 2025 |
| Externally published | Yes |
| Event | 23th IFAC Symposium on Automatic Control in Aerospace, ACA 2025 - Harbin, China Duration: 2 Aug 2025 → 6 Aug 2025 |
Keywords
- Multi-spacecraft OPEG
- autonomous decision-making
- genetic algorithm
- hierarchical architecture
- reinforcement learning