Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Object Servoing of Differential-Drive Robots

Object Servoing of Differential-Drive Service Robots Using Switched Control.

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Robust Control of Parallel Four-axis Electric Servo Platform Based on Relative Coupling Error

Modeling and Control of Differential-Drive Chassis for a Homecare Assistive Robot

Trajectory Optimization for 3D Shape-Changing Robots with Differential Mobile Base.

Robust Servo Linear Quadratic Regulator Controller Based on State Compensation and Velocity Feedforward of the Spherical Robot: Theory and Experimental Verification

Autonomous Parking: A Unified Motion Planning Framework Based On Simultaneous Dynamic Optimization

A Switching Control Approach Based on Hybrid Visual Servoing

Parking Robot Path-Tracking System Based on Discrete PID Algorithm

Performance-Oriented Coordinated Adaptive Robust Control For Four-Wheel Independently Driven Skid Steer Mobile Robot

Time-Optimal Maneuver Planning in Automatic Parallel Parking Using a Simultaneous Dynamic Optimization Approach

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

A Unified Motion Planning Method for Parking an Autonomous Vehicle in the Presence of Irregularly Placed Obstacles

Analysis on an uncalibrated image-based visual servoing for 6 DOF industrial welding robots

Universal Trajectory Optimization Framework for Differential Drive Robot Class

Hybrid Model Predictive Control with Penalty Factor Based on Image-Based Visual Servoing for Constrained Mobile Robots

Parking Like a Human: A Direct Trajectory Planning Solution

A Novel Assistive Controller Based on Differential Geometry for Users of the Differential-Drive Wheeled Mobile Robots

Adaptive Shape Servoing of Elastic Rods using Parameterized Regression Features and Auto-Tuning Motion Controls

Learning-based Feedback Controller for Deformable Object Manipulation