Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

Vision-Based Dynamic Control of Car-Like Mobile Robots

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

An Extended Immersion and Invariance for Acceleration-Level Pseudo-Dynamic Visual Regulation of Mobile Robots

Kinematics Based Visual Localization for Skid-Steering Robots: Algorithm and Theory.

Visual-Inertial Localization for Skid-Steering Robots with Kinematic Constraints

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Performance-Oriented Coordinated Adaptive Robust Control For Four-Wheel Independently Driven Skid Steer Mobile Robot

Vision-Based Control of an Industrial Vehicle in Unstructured Environments

Vision-based Adaptive Tracking Control of Uncertain Nonholonomic Mobile Robots

A Vision-Based Position Control Methodology to Drive Mobile Robots Towards Target Positions

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Receding-Horizon Vision Guidance with Smooth Trajectory Blending in the Field of View of Mobile Robots

Trajectory Tracking Control of Car-like Mobile Robots Based on Extended State Observer and Backstepping Control

Model-Based Coordinated Trajectory Tracking Control of Skid-Steer Mobile Robot with Timing-Belt Servo System

Visual Tracking and Depth Estimation of Mobile Robots Without Desired Velocity Information.

Adaptive Control of Unicycle-Type Mobile Robots with Longitudinal Slippage

Unified Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Euclidean Reconstruction.

Neural-Fuzzy-Based Adaptive Sliding Mode Automatic Steering Control of Vision-based Unmanned Electric Vehicles

Adaptive Robust Control of Skid Steer Mobile Robot with Independent Driving Torque Allocation

Model-Based Coordinated Control of Four-Wheel Independently Driven Skid Steer Mobile Robot with Wheel/Ground Interaction and Wheel Dynamics

An adaptive fuzzy-sliding lateral control strategy of automated vehicles based on vision navigation