Abstract:This paper aims to present the design and validation of a deep learning-based pipeline for estimating the pose of an uncooperative target spacecraft, from a single grayscale monocular image. The possibility of enabling autonomous vision-based relative navigation in close proximity to a non-cooperative space object has recently gained interest in the space industry. In particular, such a technology would be especially appealing for Active Debris Removal (ADR) missions as well as in an on-orbit servicing scenario. The use of a simple camera, compared to more complex sensors such as a LiDAR, has numerous advantages in terms of lower mass, volume, and power requirements. This would translate into a substantially cheaper chaser space-craft, at the expense of increased complexity of the image processing algorithms. The Relative Pose Estimation Pipeline (RPEP) proposed in this work leverages state-of-the-art Convolutional Neural Network (CNN) architectures to detect the features of the target spacecraft from a single monocular image. Speciﬁcally, the overall pipeline is composed of three main subsystems. The input image is ﬁrst of all processed using an object detection CNN that localizes the portion of the image enclosing our target, i.e. the bounding box. This is followed by a second CNN that regresses the location of semantic keypoints of the spacecraft. Eventually, a geometric optimization algorithm exploits the detected keypoint locations to solve for the ﬁnal relative pose, based on the knowledge of camera intrinsics and of a wireframe model of the target satellite. The Spacecraft PosE Estimation Dataset (SPEED), a collection of 15300 images of the Tango spacecraft released by the Space rendezvous LABoratory (SLAB), has been used for training the deep neural networks employed in our pipeline, as well as for evaluating performance and estimation uncertainty. The proposed RPEP pipeline guarantees on SPEED a centimeter-level position accuracy and degree-level attitude accuracy, along with considerable robustness to changes in illumination and background conditions. In addition, our architecture showed to generalize well on real images, despite having exclusively exploited synthetic data to train the CNNs.

Space Target Docking Ring Recognition and Center Point Positioning Based on Tiny Darknet YOLOv3 Fusion CenterNet

A Fast Binocular Localisation Method For Auv Docking

Spacecraft Components Detection Based on a Lightweight YOLOv3 Model

Autonomous measurement and semantic segmentation of non-cooperative targets with deep convolutional neural networks

Monocular Feed-forward Based 3D Target Aiming Using a 6-DOF Robotic Arm

Research on Target Hybrid Recognition and Localization Methods Based on an Industrial Camera and a Depth Camera in Complex Scenes

The Detection of Non-Cooperative Targets in Space by Using 3D Point Cloud

AI-based monocular pose estimation for autonomous space refuelling

Target Recognition and Location Based on Deep Learning

Research on Multi-Hole Localization Tracking Based on a Combination of Machine Vision and Deep Learning

Automated visual positioning and precision placement of a workpiece using deep learning

An Improved Estimation Algorithm of Space Targets Pose Based on Multi-Modal Feature Fusion

Target Localization Method of Non-Cooperative Spacecraft on On-Orbit Service

Machine visual perception from sim-to-real transfer learning for autonomous docking maneuvers

Target positioning method in binocular vision manipulator control based on improved canny operator

Multi-robot object tracking and docking systems based on networked control frames

DEEP LEARNING-BASED MONOCULAR RELATIVE POSE ESTIMATION OF UNCOOPERATIVE SPACECRAFT

Robot grasping system based on deep learning target detection

An improved model for target detection and pose estimation of a teleoperation power manipulator

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

Relative Pose Estimation of Non-Cooperative Space Targets Using a TOF Camera