Abstract:Highlights • A two-phase visual servoing is proposed to capture the tumbling satellite. • The image-based and pose-based visual models are established for each phase. • The constraints during the visual servoing are formulated. • A nonlinear model predictive controller is designed to address constraints. • The unbiased prediction is realized by disturbance compensation. In this paper, a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator. The primary challenge addressed is the potential for the docking ring to leave the monocular camera's field-of-view as the manipulator approaches the target, due to the ring's large size. To solve this issue, a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed. In an effort to augment the success rate and safety of capture operations, several constraints are formulated, encompassing manipulator's kinematics, monocular camera's field-of-view, obstacle avoidance, structured light's breakpoints and smooth capture. Subsequently, a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system. System models are established based on image moments and pose for each phase, selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement. Furthermore, to ensure unbiased predictions, the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter, which are then incorporated into the predictive control framework. The simulation results demonstrate the effectiveness of this scheme.

The rendezvous and docking of spacecrafts with image-based visual servo technology

Position-based visual servo control of autonomous robotic manipulators

Modeling and simulation of space robot visual servoing for autonomous target capturing

A Switching Control Approach Based on Hybrid Visual Servoing

Trajectory Planning for Visual Servoing with Some Constraints

Study of vision-based relative navigation for satellites formation flying

Image-Feature-Based Integrated Path Planning and Control for Spacecraft Rendezvous Operations

Visual Servo Kinematic Control For Robotic Manipulators

Research on the visual servo system of a free-floating space robot

Robust image-based control for spacecraft uncooperative rendezvous and synchronization using a zooming camera

Image-Based Visual Servoing for Enhanced Cooperation of Dual-Arm Manipulation

An Image Based Visual Servo Method for Probe-and-Drogue Autonomous Aerial Refueling

A hybrid visual servoing control of 4 DOFs space robot

Vision-aided Attitude Determination for Air-bearing Simulator of Rendezvous and Docking

Visual Servoing Using Non-Vector Space Control Theory

Manual Control Rendezvous and Docking Simulation Based on Cross Drone

The Approach and Simulation Study of the Relative Pose Measurement Between Space-crafts Based on Stereo Vision

Image-Based Visual Servoing of Quadrotors to Arbitrary Flight Targets

Two-phase visual servoing for capturing tumbling non-cooperative satellites with a space manipulator

Spacecraft Formation Keeping and Reconfiguration Using Optimal Visual Servoing