Abstract:Assembly positioning by visual servoing (VS) is a basis for autonomous robotic assembly. In practice, VS control suffers potential stability and convergence problems due to image and physical constraints, e.g., field of view constraints, image local minima, obstacle collisions, and occlusion. Therefore, this article proposes a novel deep reinforcement learning-based hybrid visual servoing (DRL-HVS) controller for motion planning of VS tasks. DRL-HVS controller takes current observed image features and camera pose as inputs, and the core parameters of hybrid VS are dynamically optimized using a deep deterministic policy gradient (DDPG) algorithm to obtain an optimal motion scheme, considering image/physical constraints and robot motion performance. In addition, an adaptive exploration strategy is proposed to further improve the training efficiency by adaptively tuning the exploration noise parameters. In this way, the offline pretrained DRL-HVS controller in the virtual environment, where the DDPG actor–critic network is continuously optimized, can be quickly deployed to a real robot system for real-time control. Experiments based on an eye-in-hand VS system are conducted with a calibrated HIKVISION RGB camera mounted on the end-effector of a GSK-RB03A1 six degree-of-freedom (6-DoF) robot. Basic VS task experiments show that the proposed controller achieves better performance than the existing methods: the servoing time is 24% smaller than that of the five-dimensional VS method, a 100% success rate with the perturbed ranges of the initial position within 25 mm for translation and 20° for rotation, and a 48% efficiency improvement. Moreover, a planetary gear component assembly process case study, where the robot aims to automatically put the gears on the gear shafts, is conducted to demonstrate the applicability of the proposed method in practice.

A Vision-based Demonstration and Verification Platform for Path Planning

Path Planning for Automated Navigation in Virtual Environment

A Computer Vision for Navigation of Mobile Robots

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Vision Based Sidewalk Navigation for Last-mile Delivery Robot

A novel methodology for vision-based path planning and obstacle avoidance in mobile robot applications

Wheeled Robots Path Planing and Tracking System Based on Monocular Visual SLAM

View Planning in Robot Active Vision: A Survey of Systems, Algorithms, and Applications

Vision-Based Real-Time Obstacles Detection and Tracking for Autonomous Vehicle Guidance

Vision-based Mobile Robot's Environment Outdoor Perception

Vision-based mobile robot navigation through deep convolutional neural networks and end-to-end learning

Vision-based autonomous mapping and exploration on robot tracked vehicle

Path planning for visual servoing with search algorithm

Guidance: A visual sensing platform for robotic applications

A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs

A Method to Plan the Path of a Robot Utilizing Deep Reinforcement Learning and Multi-Sensory Information Fusion

Automatic Robot Path Planning for Visual Inspection from Object Shape

S2P2: Self-Supervised Goal-Directed Path Planning Using RGB-D Data for Robotic Wheelchairs

Obstacle Avoidance Path Planning Algorithm of an Embedded Robot Based on Machine Vision

Computer Vision-Based Path Planning for Robot Arms in Three-Dimensional Workspaces Using Q-Learning and Neural Networks

Visual Local Path Planning Based on Deep Reinforcement Learning