Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Visual servoing based on fuzzy adaptive PID with modified smith predictor for micromanipulation

Design of Fuzzy Control System for PMSM Based on DSP

Optimal and Intelligent Motion Control Scheme for an Ultrasonic-Motor-Driven X-Y Stage

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Dynamic control set-model predictive control for field-oriented control of VSI-PMSM

Position-Based Visual Servoing Control for Multi-Joint Hydraulic Manipulator

Hybrid vision control apply on automatic pneumatic micromanipulation system

Discrete-Time Visual Servoing Control with Adaptive Image Feature Prediction Based on Manipulator Dynamics

A Switching Control Approach Based on Hybrid Visual Servoing

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Fuzzy Adaptive Model Predictive Control for Image-based Visual Servoing of Robot Manipulators With Kinematic Constraints

MPPI-VS: Sampling-Based Model Predictive Control Strategy for Constrained Image-Based and Position-Based Visual Servoing

Vision-based neural predictive tracking control for multi-manipulator systems with parametric uncertainty

Visual servo of uncalibrated eye-in-hand system with time-delay compensation

A Hierarchical Data-Driven Predictive Control of Image-Based Visual Servoing Systems With Unknown Dynamics

A Fuzzy PID Approach for the Vibration Control of the FSPM

Adaptive Event-Triggered Control For Uncalibrated Visual Servoing of Robot Manipulators

Visual servoing control for robot-assisted micro-invasive surgery systems based on optical positioning

Precision Motion Control Of Permanent Magnet Linear Synchronous Motor Servo System Based On An Integrated Controller With Inertia Variation Compensation

Multiple closed-loop control based on improved Smith predictor

Visual Servoing Tracking Control of a Ball and Plate System: Design, Implementation and Experimental Validation