Method for Cluster Satellite Orbit Pursuit-Evasion Game Based on Multi-agent Deep Deterministic Policy Gradient Algorithm
CSTR:
Author:
Affiliation:

(1.Shanghai Institute of Aerospace Systems Engineering, Shanghai 201109, China;2.school of Astronautics, Northwestern Polytechnical University, Xi’an 710109, Shaanxi, China)

Clc Number:

V 448.21

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    A method based on multi-agent deep reinforcement learning algorithm is proposed for the multiple satellites and non-cooperative targets in the orbital pursuit-evasion game, which has complex dynamics model, unknown maneuver information of non-cooperative targets, and challenge to coordinate effectively among satellites. Firstly, the game scenario is modeled, the reward function is reshaped and improved under the scenarios of minimum time, optimal fuel and collision avoidance. The multi-agent deep deterministic policy gradient algorithm is used for centralized training to obtain the optimal pursuit policy parameters of each pursuing satellite and evading satellite. Then the distributed execution enables multiple pursuing satellites and evading satellites to complete the pursuit-evasion game. The simulation results show that the method can complete the pursuit-evasion game of multiple satellites against non-cooperative targets and use the numerical advantage to effectively increase the success rate of pursuit and reduce the energy consumption in the pursuit process. Moreover, a series of intelligent game behaviors such as “interception”, “siege”, “infiltration”, and “capture” emerge, which are conducive to effectively achieve the game purpose.

    Reference
    Related
    Cited by
Get Citation

XU Xusheng, DANG Zhaohui, SONG Bin, YUAN Qiufan, XIAO Yuzhi. Method for Cluster Satellite Orbit Pursuit-Evasion Game Based on Multi-agent Deep Deterministic Policy Gradient Algorithm[J]. AEROSPACE SHANGHAI(CHINESE & ENGLISH),2022,39(2):24-31.

Copy
Related Videos

Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:November 18,2021
  • Revised:January 30,2022
  • Adopted:
  • Online: April 27,2022
  • Published:
Article QR Code