Abstract:Highlights • A two-phase visual servoing is proposed to capture the tumbling satellite. • The image-based and pose-based visual models are established for each phase. • The constraints during the visual servoing are formulated. • A nonlinear model predictive controller is designed to address constraints. • The unbiased prediction is realized by disturbance compensation. In this paper, a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator. The primary challenge addressed is the potential for the docking ring to leave the monocular camera's field-of-view as the manipulator approaches the target, due to the ring's large size. To solve this issue, a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed. In an effort to augment the success rate and safety of capture operations, several constraints are formulated, encompassing manipulator's kinematics, monocular camera's field-of-view, obstacle avoidance, structured light's breakpoints and smooth capture. Subsequently, a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system. System models are established based on image moments and pose for each phase, selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement. Furthermore, to ensure unbiased predictions, the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter, which are then incorporated into the predictive control framework. The simulation results demonstrate the effectiveness of this scheme.

Robust image-based control for spacecraft uncooperative rendezvous and synchronization using a zooming camera

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Visual Object Servo Tracking Based on the Particle Filter Method Using a Pan-Tilt-Zoom Camera

Occlusion Avoidance in Image-Based Control of Multiple Spacecraft

Two-phase visual servoing for capturing tumbling non-cooperative satellites with a space manipulator

A Switching Control Approach Based on Hybrid Visual Servoing

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Autonomous Control of the Large-Angle Spacecraft Maneuvers in a Non-Cooperative Mission

Image-Based Visual Servoing for Enhanced Cooperation of Dual-Arm Manipulation

A Study on Robust Finite-Time Visual Servoing with a Gyro-Stabilized Surveillance System

Navigation Function Based Visual Servo Control

Perception-Aware Image-Based Visual Servoing of Aggressive Quadrotor UAVs

Resilient adaptive trajectory tracking control for uncalibrated visual servoing systems with unknown actuator failures

Modeling and simulation of space robot visual servoing for autonomous target capturing

Spacecraft Formation Keeping and Reconfiguration Using Optimal Visual Servoing

Robust Vision-Based Control of a Rotorcraft UAV for Uncooperative Target Tracking

Output feedback image-based visual servoing control of an underactuated unmanned aerial vehicle

Dynamic Image-Based Output Feedback Control for Visual Servoing of Multirotors

An Optimization-Based Approach for Fusing Image-Based Trajectory Generation with Position-Based Visual Servo Control

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing