Abstract:Conventional spacecraft Guidance, Navigation, and Control (GNC) architectures have been designed to receive and execute commands from ground control with minimal automation and autonomy onboard spacecraft. In contrast, Artificial Intelligence (AI)-based systems can allow real-time decision-making by considering system information that is difficult to model and incorporate in the conventional decision-making process involving ground control or human operators. With growing interests in on-orbit services with manipulation, the conventional GNC faces numerous challenges in adapting to a wide range of possible scenarios, such as removing unknown debris, potentially addressed using emerging AI-enabled robotic technologies. However, a complete paradigm shift may need years' efforts. As an intermediate solution, we introduce a novel visual GNC system with two state-of-the-art AI modules to replace the corresponding functions in the conventional GNC system for on-orbit manipulation. The AI components are as follows: (i) A Deep Learning (DL)-based pose estimation algorithm that can estimate a target's pose from two-dimensional images using a pre-trained neural network without requiring any prior information on the dynamics or state of the target. (ii) A technique for modeling and controlling space robot manipulator trajectories using probabilistic modeling and reproduction to previously unseen situations to avoid complex trajectory optimizations on board. This also minimizes the attitude disturbances of spacecraft induced on it due to the motion of the robot arm. This architecture uses a centralized camera network as the main sensor, and the trajectory learning module of the 7 degrees of freedom robotic arm is integrated into the GNC system. The intelligent visual GNC system is demonstrated by simulation of a conceptual mission-AISAT. The mission is a micro-satellite to carry out on-orbit manipulation around a non-cooperative CubeSat. The simulation shows how the GNC system works in discrete-time simulation with the control and trajectory planning are generated in Matlab/Simulink. The physics rendering engine, Eevee, renders the whole simulation to provide a graphic realism for the DL pose estimation. In the end, the testbeds developed to evaluate and demonstrate the GNC system are also introduced. The novel intelligent GNC system can be a stepping stone toward future fully autonomous orbital robot systems.

Review on key technologies of space intelligent grasping robot

Progress and Development Trend of Space Intelligent Robot Technology

Advances in Space Robots for On‐Orbit Servicing: A Comprehensive Review

Autonomous Grasping of a Space Robot Multisensory Gripper

Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing

Intelligent Grasping of an Underactuated Hand for Space Robots

Autonomous Rendezvous and Robotic Capturing of Non-Cooperative Target in Space

Research Progress of Space Robots and Key Technologies of Gecko-Inspired Robots

Dual-Arm space robot system design and coordination operations technology research

Advances in Space Robot On-orbit Servicing for Non-cooperative Spacecraft

Soft Robots for Space Applications:Actuation,Modeling and Sensing

Review on modeling, planning and control of space robot

Intelligent Spacecraft Visual GNC Architecture With the State-Of-the-Art AI Components for On-Orbit Manipulation

Intelligent Space System Oriented to the Home Service Robot

Autonomous Planning and Experiments of Space Robot Based on Hand-eye Measurement

A Survey of Space Robotic Technologies for On-Orbit Assembly

Research and Development of Intelligent Space Technology for a Home Service Robot

A Comprehensive Review of Robot Intelligent Grasping Based on Tactile Perception.

Review of key technologies of climbing robots

Review of Space Manipulator Technology