Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Study on Intelligent Visual Servoing of Space Robot for Cooperative Target Capturing

Modeling and simulation of space robot visual servoing for autonomous target capturing

Autonomous Planning and Experiments of Space Robot Based on Hand-eye Measurement

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Trajectory Planning for Visual Servoing with Some Constraints

A Modelling and Simulation System of Space Robot for Capturing Non-Cooperative Target

Two-phase visual servoing for capturing tumbling non-cooperative satellites with a space manipulator

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Image-Based Visual Servoing for Enhanced Cooperation of Dual-Arm Manipulation

Hybrid Multi-camera Visual Servoing to Moving Target

Moving to OOP: An Active Observation Approach for a Novel Composite Visual Servoing Configuration

Autonomous Path Planning and Experiment Study of Free-Floating Space Robot for Spinning Satellite Capturing

Visual Servoing for Robotic On-Orbit Servicing: A Survey

A Small Family Service Robot System with Uncalibrated Monocular Camera for Visual Servoing Tracking Fast Moving Family Targets in Short Range

Visual servoing control for robot-assisted micro-invasive surgery systems based on optical positioning

Deep neural network-based robotic visual servoing for satellite target tracking

A Monocular Structured Light Vision Method for Pose Determination of Large Non-Cooperative Satellites

Robotic Visual Servoing Around a Static Target: An Example of Controlled Active Vision

Visual servoing of quadrotor UAVs for slant targets with autonomous object search

Concept and realization of semi-physical simulation for space robotic visual servoing

Vision-Based Object Recognition and Precise Localization for Space Body Control