Abstract:Conventional spacecraft Guidance, Navigation, and Control (GNC) architectures have been designed to receive and execute commands from ground control with minimal automation and autonomy onboard spacecraft. In contrast, Artificial Intelligence (AI)-based systems can allow real-time decision-making by considering system information that is difficult to model and incorporate in the conventional decision-making process involving ground control or human operators. With growing interests in on-orbit services with manipulation, the conventional GNC faces numerous challenges in adapting to a wide range of possible scenarios, such as removing unknown debris, potentially addressed using emerging AI-enabled robotic technologies. However, a complete paradigm shift may need years' efforts. As an intermediate solution, we introduce a novel visual GNC system with two state-of-the-art AI modules to replace the corresponding functions in the conventional GNC system for on-orbit manipulation. The AI components are as follows: (i) A Deep Learning (DL)-based pose estimation algorithm that can estimate a target's pose from two-dimensional images using a pre-trained neural network without requiring any prior information on the dynamics or state of the target. (ii) A technique for modeling and controlling space robot manipulator trajectories using probabilistic modeling and reproduction to previously unseen situations to avoid complex trajectory optimizations on board. This also minimizes the attitude disturbances of spacecraft induced on it due to the motion of the robot arm. This architecture uses a centralized camera network as the main sensor, and the trajectory learning module of the 7 degrees of freedom robotic arm is integrated into the GNC system. The intelligent visual GNC system is demonstrated by simulation of a conceptual mission-AISAT. The mission is a micro-satellite to carry out on-orbit manipulation around a non-cooperative CubeSat. The simulation shows how the GNC system works in discrete-time simulation with the control and trajectory planning are generated in Matlab/Simulink. The physics rendering engine, Eevee, renders the whole simulation to provide a graphic realism for the DL pose estimation. In the end, the testbeds developed to evaluate and demonstrate the GNC system are also introduced. The novel intelligent GNC system can be a stepping stone toward future fully autonomous orbital robot systems.

European Satellite Benchmark for Control Education and Industrial Training

Satellite and robotic arm combined control for spacecraft close-proximity operations

Benchmarking Metric Ground Navigation

Autonomous Aerospace Technologies in Spacesyslab – A Robotic-Based Rendezvous and Docking System

CDIO-Based Outstanding Engineers Training Model in Aerospace

Training Datasets Generation for Machine Learning: Application to Vision Based Navigation

Modeling and Robust Controller Design for Formation Flight Ground Tests Based on Air-Bearing Table

Implementation of Three DoFs Small Satellite Ground Simulation System

START: A Satellite Three Axis Rotation Testbed

Intelligent Spacecraft Visual GNC Architecture With the State-Of-the-Art AI Components for On-Orbit Manipulation

On the Automation, Optimization, and In-Orbit Validation of Intelligent Satellite Constellation Operations

Simulation and Analysis of Galileo System

GICI-LIB: A GNSS/INS/Camera Integrated Navigation Library

A six-degree-of-freedom hardware-in-the-loop simulator for small spacecraft

Exploration of Aerospace Talents Training Mode: Innovation Workshop

The Integrated System For Design, Analysis, System Simulation And Evaluation Of The Small Satellite

Spacecraft Attitude Testbed

An Innovative Low-Power, Low-Cost, Multi-Constellation Geodetic-Grade Global Navigation Satellite System Reference Station for the Densification of Permanent Networks: The GREAT Project

Experiment Course Design and Practice of Principle of Satellite Navigation