Abstract:In this work, we investigate the problem of multisatellite resource allocation for expected long-term performance optimization with a dynamic task network model, where communication tasks generated by task satellites are expected to be transmitted by resource satellites in the application layer, and the set of tasks changes with satellite orbital motions. The features of the tasks include priority, execution duration, visible time, etc. Since the feature information has a high dimension and changes with time, the scheduling problem is formulated as a dynamic combinatorial optimization problem and a receding-horizon task scheduling algorithm based on the event-triggered deep reinforcement learning is proposed. A residual-fully connected network is designed to extract the features of the complex task network model, and a deep double Q-learning iteration with the experience replay memory mechanism is employed to change the allocation strategy by evaluated rewards adaptively. An event-triggered strategy is then proposed to handle urgent tasks online. Numerical simulations show the performance improvement of the proposed algorithm. For the scenario of 50 task satellites and ten resource satellites, the proposed algorithm achieves 4.1%, 5.9%, and 11.4% higher reward scores than the static deep reinforcement learning algorithm, the data-driven parallel scheduling algorithm, and the improved genetic algorithm, respectively. The computation time of the proposed algorithm is only 34.7% and 21.3% of that of the latter two algorithms, and is similar to that of the static deep reinforcement learning algorithm.

Reinforcement-Learning-Based Task Planning for Self-Reconfiguration of Cellular Satellites

Autonomous Target Revisiting Planning for LEO Observing Constellations Based on Improved Contract Network Protocol

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

A Self-Reconfiguration Planning Strategy for Cellular Satellites.

Intelligent algorithm-based cellular robot self-reconfiguration step planning research

A Distributed Self-Reconfiguration Planning Algorithm for Modular Satellites

Deep Reinforcement Learning-Based Periodic Earth Observation Scheduling for Agile Satellite Constellation.

PO-SRPP: A Decentralized Pivoting Path Planning Method for Self-Reconfigurable Satellites

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Autonomous Reconfiguration of Homogeneous Pivoting Cube Modular Satellite by Deep Reinforcement Learning

Reinforcement Learning-enabled Satellite Constellation Reconfiguration and Retasking for Mission-Critical Applications

Anti-collision Trajectory Planning for Satellite Formation Reconstruction Based on Deep Reinforcement Learning

An Efficient Task Autonomous Planning Method for Small Satellites

A Distributed Cooperative Dynamic Task Planning Algorithm for Multiple Satellites Based on Multi-agent Hybrid Learning

Real-Time Re-Planning for Satellite Formation Reconfiguration in Deep Space

Reinforcement Learning-Based Task Scheduling Algorithm for On-Satellite Data Analysis

A Satellite Task Planning Algorithm Based On A Symmetric Recurrent Neural Network

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multi-Satellite Resource Allocation

Event-Triggered Deep Reinforcement Learning for Dynamic Task Scheduling in Multisatellite Resource Allocation.

Distributed Satellite Mission Planning via Learning in Games

Reinforcement Learning-Based Multi-Impulse Rendezvous Approach for Satellite Constellation Reconfiguration