Abstract:The cooperative positioning problem of hypersonic vehicles regarding LEO constellations is the focus of this research study on space-based early warning systems. A hypersonic vehicle is highly maneuverable, and its trajectory is uncertain. New challenges are posed for the cooperative positioning capability of the constellation. In recent years, breakthroughs in artificial intelligence technology have provided new avenues for collaborative multi-satellite intelligent autonomous decision-making technology. This paper addresses the problem of multi-satellite cooperative geometric positioning for hypersonic glide vehicles (HGVs) by the LEO-constellation-tracking system. To exploit the inherent advantages of hierarchical reinforcement learning in intelligent decision making while satisfying the constraints of cooperative observations, an autonomous intelligent decision-making algorithm for satellites that incorporates a hierarchical proximal policy optimization with random hill climbing (MAPPO-RHC) is designed. On the one hand, hierarchical decision making is used to reduce the solution space; on the other hand, it is used to maximize the global reward and to uniformly distribute satellite resources. The single-satellite local search method improves the capability of the decision-making algorithm to search the solution space based on the decision-making results of the hierarchical proximal policy-optimization algorithm, combining both random hill climbing and heuristic methods. Finally, the MAPPO-RHC algorithm's coverage and positioning accuracy performance is simulated and analyzed in two different scenarios and compared with four intelligent satellite decision-making algorithms that have been studied in recent years. From the simulation results, the decision-making results of the MAPPO-RHC algorithm can obtain more balanced resource allocations and higher geometric positioning accuracy. Thus, it is concluded that the MAPPO-RHC algorithm provides a feasible solution for the real-time decision-making problem of the LEO constellation early warning system.

Decentralized decision making over random graphs for space domain awareness

Optimizing Participant Selection for Fault-Tolerant Decision Making in Orbit Using Mixed Integer Linear Programming

Multi-granularity onboard decision method for optical space surveillance satellite

Decision-Making for Satellite Anti-Interception Missions Leveraging Multi-Agent Reinforcement Learning

Decentralized Multi-Agent Active Search and Tracking when Targets Outnumber Agents

Coordination of Decisions in a Spatial Agent Model

Distributed Satellite Mission Planning via Learning in Games

Communication- and Computation-Efficient Distributed Decision-Making in Multi-Robot Networks

On Game Based Distributed Decision Approach for Multi-agent Optimal Coverage Problem with Application to Constellations Reconfiguration

On the Role of Communications for Space Domain Awareness

Distributed decentralized receding horizon control for very large-scale networks with application to satellite mega-constellations

Collaborative Decision-Making Using Spatiotemporal Graphs in Connected Autonomy

Decentralized Decision for Multi-Band Sensing: A Deep Reinforcement Learning Approach

Decentralized Search and Track with Multiple Autonomous Agents

A game theoretic self-organization for satellite-based optical sensor allocation

A communication architecture for reaching consensus in decision for a large network

An LEO Constellation Early Warning System Decision-Making Method Based on Hierarchical Reinforcement Learning

Decentralized Control of Three-Dimensional Mobile Robotic Sensor Networks

Asynchronous Decentralized 20 Questions for Adaptive Search

Decentralized and Communication-Free Multi-Robot Navigation through Distributed Games

Navigation Function Based Decentralized Control of A Multi-Agent System with Network Connectivity Constraints