Abstract:Conventional spacecraft Guidance, Navigation, and Control (GNC) architectures have been designed to receive and execute commands from ground control with minimal automation and autonomy onboard spacecraft. In contrast, Artificial Intelligence (AI)-based systems can allow real-time decision-making by considering system information that is difficult to model and incorporate in the conventional decision-making process involving ground control or human operators. With growing interests in on-orbit services with manipulation, the conventional GNC faces numerous challenges in adapting to a wide range of possible scenarios, such as removing unknown debris, potentially addressed using emerging AI-enabled robotic technologies. However, a complete paradigm shift may need years' efforts. As an intermediate solution, we introduce a novel visual GNC system with two state-of-the-art AI modules to replace the corresponding functions in the conventional GNC system for on-orbit manipulation. The AI components are as follows: (i) A Deep Learning (DL)-based pose estimation algorithm that can estimate a target's pose from two-dimensional images using a pre-trained neural network without requiring any prior information on the dynamics or state of the target. (ii) A technique for modeling and controlling space robot manipulator trajectories using probabilistic modeling and reproduction to previously unseen situations to avoid complex trajectory optimizations on board. This also minimizes the attitude disturbances of spacecraft induced on it due to the motion of the robot arm. This architecture uses a centralized camera network as the main sensor, and the trajectory learning module of the 7 degrees of freedom robotic arm is integrated into the GNC system. The intelligent visual GNC system is demonstrated by simulation of a conceptual mission-AISAT. The mission is a micro-satellite to carry out on-orbit manipulation around a non-cooperative CubeSat. The simulation shows how the GNC system works in discrete-time simulation with the control and trajectory planning are generated in Matlab/Simulink. The physics rendering engine, Eevee, renders the whole simulation to provide a graphic realism for the DL pose estimation. In the end, the testbeds developed to evaluate and demonstrate the GNC system are also introduced. The novel intelligent GNC system can be a stepping stone toward future fully autonomous orbital robot systems.

Inverse Simulation System for Manual-Controlled Rendezvous and Docking Based on Artificial Neural Network

A Virtual MPC-Based Artificial Neural Network Controller for PMSM Drives in Aircraft Electric Propulsion System

Error Analysis and Modification of Inverse Simulation for Manually Controlled Rendezvous and Docking

Nonlinear Model Predictive Control of Space Redundant Manipulators

Manual Control Rendezvous and Docking Simulation Based on Cross Drone

An Intelligent Control Method Based on Artificial Neural Network for Numerical Flight Simulation of the Basic Finner Projectile with Pitching Maneuver

Neural-based Control for CubeSat Docking Maneuvers

Event-triggered Model Predictive Controller with Neural Network for Autonomous Rendezvous and Proximity on Elliptical Orbits

Neural adaptive control for a ground experiment of the space proximity operation in a six-degree-of-freedom micro-gravity simulation system

Real-Time Terminal Guidance for Autonomous Spacecraft Capture of Free Floating Objects Using Model Predictive Control

An Adaptive Control Mechanism for Improving the Loading Precision of Aircraft Hydraulic Servo Load Simulator

ASV station keeping under wind disturbances using neural network simulation error minimization model predictive control

Modeling Human Behavior in Manual Control Rendezvous and Docking Task

Study on Synthetic Evaluation of Human Performance in Manually Controlled Spacecraft Rendezvous and Docking Tasks

Intelligent Spacecraft Visual GNC Architecture With the State-Of-the-Art AI Components for On-Orbit Manipulation

Modeling of Cognitive Behavior in Manual Rendezvous and Docking

Lateral Automatic Landing Control System for Cooperating to Suppress Risk and Deviations Based on MPC and NN

Control Parameters Optimization Based on Co-Simulation of a Mechatronic System for an UA-Based Two-Axis Inertially Stabilized Platform

Model Predictive Control for Docking of Micro-nano Satellite and Non-cooperative Tumbling Target

The Adaptive Inverse Control of Nonlinear Ship Maneuvering Based on Improved Radial Basis Function Neural Network

Inverse-model Neuro-control of Free-floating Space Robot with Rigid Manipulators and Rigid-flexible Manipulators