Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

A Digital Twin-Based Visual Servoing with Extreme Learning Machine and Differential Evolution

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Fast and Stable Learning of Dynamical Systems Based on Extreme Learning Machine.

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Robot Manipulator Visual Servoing Based on Image Moments and Improved Firefly Optimization Algorithm-Based Extreme Learning Machine

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Visual Servoing with Deep Learning and Data Augmentation for Robotic Manipulation

A Digital Twin-Driven Guidance Method for Human-Machine Collaborative Assembly Operations Based on Machine Learning and Computer Vision

Image-Based Composite Learning Robot Visual Servoing With an Uncalibrated Eye-to-Hand Camera

Visual servo of uncalibrated eye-in-hand system with time-delay compensation

Neuromorphic Eye-in-Hand Visual Servoing

Toward Scalable Visual Servoing Using Deep Reinforcement Learning and Optimal Control

Hybrid Multi-camera Visual Servoing to Moving Target

Direct Imitation Learning-based Visual Servoing using the Large Projection Formulation

Adaptive Finite-Time Model Estimation and Control for Manipulator Visual Servoing using Sliding Mode Control and Neural Networks

Analyzing Neural Jacobian Methods in Applications of Visual Servoing and Kinematic Control

Self-supervised Wide Baseline Visual Servoing via 3D Equivariance

Motion Prediction and Object Detection for Image-Based Visual Servoing Systems Using Deep Learning

Reinforcement-Learning-Based Visual Servoing of Underwater Vehicle Dual-Manipulator System

Siamese Convolutional Neural Network Based Visual Servo for Manipulator

Deep Direct Visual Servoing of Tendon-Driven Continuum Robots