Abstract:On-board estimation of the pose of an uncooperative target spacecraft is an essential task for future on-orbit servicing and close-proximity formation flying missions. However, two issues hinder reliable on-board monocular vision based pose estimation: robustness to illumination conditions due to a lack of reliable visual features and scarcity of image datasets required for training and benchmarking. To address these two issues, this work details the design and validation of a monocular vision based pose determination architecture for spaceborne applications. The primary contribution to the state-of-the-art of this work is the introduction of a novel pose determination method based on Convolutional Neural Networks (CNN) to provide an initial guess of the pose in real-time on-board. The method involves discretizing the pose space and training the CNN with images corresponding to the resulting pose labels. Since reliable training of the CNN requires massive image datasets and computational resources, the parameters of the CNN must be determined prior to the mission with synthetic imagery. Moreover, reliable training of the CNN requires datasets that appropriately account for noise, color, and illumination characteristics expected in orbit. Therefore, the secondary contribution of this work is the introduction of an image synthesis pipeline, which is tailored to generate high fidelity images of any spacecraft 3D model. The proposed technique is scalable to spacecraft of different structural and physical properties as well as robust to the dynamic illumination conditions of space. Through metrics measuring classification and pose accuracy, it is shown that the presented architecture has desirable robustness and scalable properties.

Pose Estimation of Large Non-Cooperative Spacecraft Based on Extended PnP Model

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Pose Estimation for Non-cooperative Spacecraft Based on Deep Learning

Pose Estimation for Cross-Domain Non-Cooperative Spacecraft Based on Spatial-Aware Keypoints Regression

Uncooperative Spacecraft Pose Estimation Based on Intensity and Range Images Fusion

Non-cooperative Target Pose Estimate of Spacecraft Based on Vectors

Pose Determination Of Non-Cooperative Spacecraft Based On Multi-Feature Information Fusion

Pose Measurement of Large Non-Cooperative Satellite Based on Collaborative Cameras

Pose Estimation of a Noncooperative Target Based on Monocular Visual SLAM

Pose Estimation for Non-Cooperative Spacecraft Rendezvous Using Convolutional Neural Networks

Rectangular Natural Feature Recognition and Pose Measurement Method for Non-Cooperative Spacecraft

Position Awareness Network for Noncooperative Spacecraft Pose Estimation Based on Point Cloud

Non-Model-Based Monocular Pose Estimation Network for Uncooperative Spacecraft Using Convolutional Neural Network

Learning-Based Pose Estimation of Non-Cooperative Spacecrafts with Uncertainty Prediction

Pose estimation of non-cooperative targets without feature tracking

A Pose Measurement Method of a Non-Cooperative Spacecraft Based on Point Cloud Feature

Non-cooperative Pose Estimation for Cubesat Based on Point Set Registration

A Monocular Structured Light Vision Method for Pose Determination of Large Non-Cooperative Satellites

Monocular Vision-based Relative Pose Parameters Determination for Non-cooperative Spacecrafts

Rectangular-structure-based pose estimation method for non-cooperative rendezvous