Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

A Universal State-Space Approach to Uncalibrated Model-Free Visual Servoing

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Adapting for Calibration Disturbances: A Neural Uncalibrated Visual Servoing Policy

Model-Free Uncalibrated Visual Servoing Using Recursive Least Squares.

Uncalibrated Eye-in-hand Visual Servoing Using Recursive Least Squares

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Visual Object Servo Tracking Based on the Particle Filter Method Using a Pan-Tilt-Zoom Camera

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Uncalibrated Eye-in-hand Visual Servoing Using Adaptive Recursive Least Squares

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Image-Based Visual Servoing for USV under Wave Perturbations

A Switching Control Approach Based on Hybrid Visual Servoing

Fully Uncalibrated Image-Based Visual Servoing of 2DOFs Planar Manipulators With a Fixed Camera

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Modeling and simulation of space robot visual servoing for autonomous target capturing

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Unified Visual Servoing Tracking and Regulation of Wheeled Mobile Robots With an Uncalibrated Camera

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

A Exponential Class Of Model-Free Visual Servoing Controllers In The Presence Of Uncertain Camera Calibration

Applications of Uncalibrated Image Based Visual Servoing in Micro- and Macroscale Robotics

Robust Uncalibrated Visual Servoing Control Based on Disturbance Observer.