Abstract:The pose (position and attitude) measurement of space non-cooperative targets is one of the key technologies in on-orbit service. Traditional stereo-vision-based methods are easily affected by illumination conditions, while the 3D laser radar has a good stability, but the point cloud is sparse. In this paper, a method based on the 3D laser radar and stereo-vision information is proposed to measure the pose and estimate the motion for non-cooperative targets. The proposed method can not only adapt to the harsh lighting conditions, but also has better robustness and higher precision. First, find the matching point corresponding to the binocular camera by using the stereo matching algorithm, and then, calculate the 3D coordinates of the matching points according to the least squares method. Combined with the fusion calibration result, the point cloud data acquired by the 3D laser radar is converted to the left camera frame. Second, integrate the point cloud data obtained by the above two sensors to obtain a complete point cloud model of the non-cooperative target. Third, the obtained point cloud model is registered, and the rigid transformation matrix of two adjacent point clouds is solved. Then, the relative pose and velocity (linear velocity and angular velocity) of the non-cooperative target are estimated by the extended Kalman filter (EKF) algorithm. Finally, an experimental system was built. It consists of a UR5 robot, a satellite mockup, two cameras, a 3D laser radar, and an API laser tracker (for evaluating the accuracy of measurement), was built. The experiment results verified the proposed method. © 2001-2012 IEEE.

3D Model-Based Detection and Tracking for Space Autonomous and Uncooperative Rendezvous

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Object tracking with 3D LIDAR via multi-task sparse learning

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

An Improved Real-Time Visual Tracking Method for Space Non-Cooperative Target

Real-time Particle Filter Tracking Method Based on Human Vision Non-uniform Characteristics

Autonomous Rendezvous and Robotic Capturing of Non-Cooperative Target in Space

Feature-tracking based pose estimation for autonomous rendezvous and docking

Accurate Pose Tracking for Uncooperative Targets via Data Fusion of Laser Scanner and Optical Camera

Real-time 3D Human Tracking for Mobile Robots with Multisensors

The Detection of Non-Cooperative Targets in Space by Using 3D Point Cloud

Novel Method of Monocular Real-Time Feature Point Tracking for Tethered Space Robots

Non-cooperative Spacecraft Pose Tracking Based on Point Cloud Feature

Monocular-Based Pose Estimation of Non-Cooperative Space Targets Using EKF and EKPF

Non-cooperative target recognition and relative motion estimation with inertial measurement unit assistance

State estimation and reconstruction of non-cooperative targets based on kinematic model and direct visual odometry

L-Shaped-Sensor-Array-Based Localization and Tracking Method for 3D Maneuvering Target.

Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion

Real-time Pose Tracking of 3D Targets by Photo-Model-based Stereo-Vision

Autonomous Rendezvous and Docking with Nonfull Field of View for Tethered Space Robot

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion