Abstract:On-board estimation of the pose of an uncooperative target spacecraft is an essential task for future on-orbit servicing and close-proximity formation flying missions. However, two issues hinder reliable on-board monocular vision based pose estimation: robustness to illumination conditions due to a lack of reliable visual features and scarcity of image datasets required for training and benchmarking. To address these two issues, this work details the design and validation of a monocular vision based pose determination architecture for spaceborne applications. The primary contribution to the state-of-the-art of this work is the introduction of a novel pose determination method based on Convolutional Neural Networks (CNN) to provide an initial guess of the pose in real-time on-board. The method involves discretizing the pose space and training the CNN with images corresponding to the resulting pose labels. Since reliable training of the CNN requires massive image datasets and computational resources, the parameters of the CNN must be determined prior to the mission with synthetic imagery. Moreover, reliable training of the CNN requires datasets that appropriately account for noise, color, and illumination characteristics expected in orbit. Therefore, the secondary contribution of this work is the introduction of an image synthesis pipeline, which is tailored to generate high fidelity images of any spacecraft 3D model. The proposed technique is scalable to spacecraft of different structural and physical properties as well as robust to the dynamic illumination conditions of space. Through metrics measuring classification and pose accuracy, it is shown that the presented architecture has desirable robustness and scalable properties.

Uncooperative Spacecraft Pose Estimation Based on Intensity and Range Images Fusion

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Pose Estimation of Non-Cooperative Space Targets Based on Cross-Source Point Cloud Fusion

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Pose Estimation of Large Non-Cooperative Spacecraft Based on Extended PnP Model

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

A Pose Measurement Method of a Non-Cooperative Spacecraft Based on Point Cloud Feature

LiDAR and Inertial Fusion for Pose Estimation by Non-linear Optimization

Novel Pose Measurement with Optimized Principal Component Analysis for Unknown Spacecraft Based on Point Cloud

Non-cooperative Target Pose Estimate of Spacecraft Based on Vectors

Rectangular Natural Feature Recognition and Pose Measurement Method for Non-Cooperative Spacecraft

Accurate Pose Tracking for Uncooperative Targets via Data Fusion of Laser Scanner and Optical Camera

High Precision Pose Estimation for Uncooperative Targets Based on Monocular Vision and 1D Laser Fusion

Position Awareness Network for Noncooperative Spacecraft Pose Estimation Based on Point Cloud

2D/3D Feature Fusion Based on Space Non-Cooperative Target Close-Range Relative Measurement

Non-cooperative Pose Estimation for Cubesat Based on Point Set Registration

A Relative Pose Estimation Method of Non-Cooperative Space Targets

Pose Estimation of a Noncooperative Target Based on Monocular Visual SLAM

Rectangular-structure-based pose estimation method for non-cooperative rendezvous

A Pose Estimation Method of Space Non-Cooperative Target Based on ORBFPFH SLAM

Pose Estimation for Non-Cooperative Spacecraft Rendezvous Using Convolutional Neural Networks