Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Robust Contour Visual Servoing Based on B-spline Features with Temporary Occlusion

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Trajectory Planning for Visual Servoing with Some Constraints

A Switching Control Approach Based on Hybrid Visual Servoing

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Dynamic performance improvement of direct image-based visual servoing in contour following

Cubic B-Spline-Based Feature Tracking for Visual–Inertial Odometry With Event Camera

Occlusion-Free Image Based Visual Servoing using Probabilistic Control Barrier Certificates

Depth-PC: A Visual Servo Framework Integrated with Cross-Modality Fusion for Sim2Real Transfer

Image-Based Visual Servoing for USV under Wave Perturbations

Perception-Aware Image-Based Visual Servoing of Aggressive Quadrotor UAVs

Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

Discrete-Time Visual Servoing Control with Adaptive Image Feature Prediction Based on Manipulator Dynamics

Direct Visual Servoing Based on Discrete Orthogonal Moments

Investigation of IBVS Control Method Utilizing Vanishing Vector Subject to Spatial Constraint

Image-fusion-based active contour model

Vision-based Manipulation of Deformable and Rigid Objects Using Subspace Projections of 2D Contours

Model Predictive Spherical Image-Based Visual Servoing On $SO(3)$ for Aggressive Aerial Tracking

Novel IBVS System Design for Cable-Driven Hyper-Redundant Manipulator With MLESAC-Based Feature Vector Optimization

Visual Servoing Based on 3D Features: Design and Implementation for Robotic Insertion Tasks

Contour-SLAM: A Robust Object-Level SLAM Based on Contour Alignment