Abstract:Accurately estimating the pose of spacecraft is indispensable for space applications. However, such targets are generally non-cooperative, i.e., no markers are mounted on them, and they include no parts for operation. Therefore, the detection and measurement of a non-cooperative target is very challenging. Stereovision sensors are important solutions in the near field. In this paper, a rectangular natural feature recognition and pose measurement method for non-cooperative spacecraft is proposed. Solar panels of spacecraft were selected as detection objects, and their image features were captured via stereo vision. These rectangle features were then reconstructed in 3D Cartesian space through parallelogram fitting on the image planes of two cameras. The vertexes of rectangle features were detected and used to solve the pose of a non-cooperative target. An experimental system was built to validate the effectiveness of the algorithm. The experimental results show that the average position measurement error of the algorithm is about 10 mm and the average attitude measurement error is less than 1°. The results also show that the proposed method achieves high accuracy and efficiency.

What problem does this paper attempt to address?

The paper attempts to address the problem of attitude measurement for non-cooperative spacecraft. Specifically, non-cooperative spacecraft do not have markers installed or parts used for operation, making the detection and measurement of these targets very challenging. The paper proposes a method based on rectangular natural feature recognition and attitude measurement, mainly targeting the detection and measurement of solar panels on non-cooperative spacecraft. ### Background and Problem Statement 1. **Needs of Space Missions**: - The development of space technology has brought many key challenges, such as on-orbit maintenance and rescue, space debris removal, satellite rendezvous and docking, companion monitoring, and on-orbit capture. - The successful execution of these missions requires precise target recognition and attitude measurement. 2. **Challenges of Non-Cooperative Targets**: - Non-cooperative targets lack known structure, size, or motion information and usually do not have cooperative markers or communication capabilities with the tracking spacecraft. - Recognizing and measuring non-cooperative targets is an important and challenging task. ### Methodology 1. **Rectangular Natural Feature Recognition**: - Solar panels of the spacecraft are chosen as the detection object because they are usually rectangular and have distinct features in images. - Stereo vision is used to capture the image features of the solar panels, and these rectangular features are reconstructed on the image planes of two cameras through parallelogram fitting. 2. **Attitude Measurement**: - The vertices of the rectangular features are detected, and these vertices are used to solve the attitude of the non-cooperative target. - An experimental system is established to verify the effectiveness of the algorithm, and the results show that the average position measurement error of the algorithm is about 10 millimeters, and the average attitude measurement error is less than 1 degree. ### Main Contributions 1. **Analysis of Imaging Characteristics of Rectangular Features on the Image Plane**: - A method based on parallelogram fitting is proposed to fit rectangular features on the image plane. 2. **Application to Attitude Measurement of Non-Cooperative Spacecraft**: - Natural features such as solar panels on non-cooperative targets can be detected and measured without adding extra cooperative markers. ### Conclusion The method proposed in the paper demonstrates high accuracy and efficiency in the attitude measurement of non-cooperative spacecraft, providing new ideas and technical support for solving key problems in space missions.

Rectangular Natural Feature Recognition and Pose Measurement Method for Non-Cooperative Spacecraft

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Rectangular-structure-based pose estimation method for non-cooperative rendezvous

An Efficient Virtual Stereo-vision Measurement Method of a Space Non-cooperative Target

A Pose Measurement Method of a Non-Cooperative GEO Spacecraft Based on Stereo Vision

A Monocular Structured Light Vision Method for Pose Determination of Large Non-Cooperative Satellites

Virtual Stereovision Pose Measurement of Noncooperative Space Targets for a Dual-Arm Space Robot

Pose Measurement of Large Non-Cooperative Satellite Based on Collaborative Cameras

Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion

Pose Estimation of Large Non-Cooperative Spacecraft Based on Extended PnP Model

The Approach and Simulation Study of the Relative Pose Measurement Between Space-crafts Based on Stereo Vision

Pose Estimation of Non-Cooperative Space Targets Based on Cross-Source Point Cloud Fusion

A Pose Measurement Method of a Space Noncooperative Target Based on Maximum Outer Contour Recognition

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Position and pose measurement technology of space combination ground experiment based on machine vision

Pose measurement method for non-cooperative space vehicle using multiple non-overlapping cameras

Non-cooperative Spacecraft Pose Tracking Based on Point Cloud Feature

Uncooperative Spacecraft Pose Estimation Based on Intensity and Range Images Fusion

Pose Estimation for Cross-Domain Non-Cooperative Spacecraft Based on Spatial-Aware Keypoints Regression