Abstract:Highlights • A two-phase visual servoing is proposed to capture the tumbling satellite. • The image-based and pose-based visual models are established for each phase. • The constraints during the visual servoing are formulated. • A nonlinear model predictive controller is designed to address constraints. • The unbiased prediction is realized by disturbance compensation. In this paper, a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator. The primary challenge addressed is the potential for the docking ring to leave the monocular camera's field-of-view as the manipulator approaches the target, due to the ring's large size. To solve this issue, a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed. In an effort to augment the success rate and safety of capture operations, several constraints are formulated, encompassing manipulator's kinematics, monocular camera's field-of-view, obstacle avoidance, structured light's breakpoints and smooth capture. Subsequently, a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system. System models are established based on image moments and pose for each phase, selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement. Furthermore, to ensure unbiased predictions, the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter, which are then incorporated into the predictive control framework. The simulation results demonstrate the effectiveness of this scheme.

Pose Measurement and Motion Estimation of Non-Cooperative Satellite Based on Spatial Circle Feature

Circular-Feature-Based Pose Estimation of Noncooperative Satellite Using Time-of-Flight Sensor

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Pose Measurement of Large Non-Cooperative Satellite Based on Collaborative Cameras

Pose Estimation for Spherical Robot with Kinematics-Based Encoder-Inertial Odometry

A Pose Measurement Method of a Non-Cooperative GEO Spacecraft Based on Stereo Vision

Pose Measurement for Capture of Large Satellite Docking Ring Based on Double-Line Structured Light Vision

Two-phase visual servoing for capturing tumbling non-cooperative satellites with a space manipulator

A Monocular Structured Light Vision Method for Pose Determination of Large Non-Cooperative Satellites

An Efficient Virtual Stereo-vision Measurement Method of a Space Non-cooperative Target

Pose estimation of CubeSats via sensor fusion and Error-State Extended Kalman Filter

Rectangular Natural Feature Recognition and Pose Measurement Method for Non-Cooperative Spacecraft

Pose Estimation of Non-Cooperative Space Targets Based on Cross-Source Point Cloud Fusion

Satellite Formation Flying Control by Using Only Angle Measurements

A Pose Measurement Method of a Space Noncooperative Target Based on Maximum Outer Contour Recognition

Dual-arm Coordinated Capturing of an Unknown Tumbling Target Based on Efficient Parameters Estimation

Position and pose measurement technology of space combination ground experiment based on machine vision

Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion

Virtual Stereovision Pose Measurement of Noncooperative Space Targets for a Dual-Arm Space Robot

Autonomous measurement and semantic segmentation of non-cooperative targets with deep convolutional neural networks

Proximity operations of CubeSats via sensor fusion of ultra-wideband range measurements with rate gyroscopes, accelerometers and monocular vision