Abstract:Abstract In the field of intelligent manufacturing, robot grasping and sorting is important content. However, there are some disadvantages in the traditional single-view-based manipulator grasping methods by using a 2D camera, where the efficiency and the accuracy of grasping are both low when facing the scene of stacking and occlusion for the reason that there is information missing by single-view 2D camera-based methods while acquiring scene information, and the methods of grasping only can’t change the difficult-to-grasp scene which is stack and occluded. Regarding the issue above, a pushing-grasping collaborative method based on the deep Q-network in dual viewpoints is proposed in this paper. This method in this paper adopts an improved deep Q-network algorithm, with an RGB-D camera to obtain the information of objects’ RGB images and point clouds from two viewpoints, which solved the problem of lack of information missing. What’s more, it combines the pushing and grasping actions with the deep Q-network, which make it have the ability of active exploration, so that the trained manipulator can make the scenes less stacking and occlusion, and with the help of that, it can perform well in more complicated grasping scenes. In addition, we improved the reward function of the deep Q-network and propose the piecewise reward function to speed up the convergence of the deep Q-network. We trained different models and tried different methods in the V-REP simulation environment, and it drew a conclusion that the method proposed in this paper converges quickly and the success rate of grasping objects in unstructured scenes raises up to 83.5%. Besides, it shows the generalization ability and well performance when novel objects appear in the scenes that the manipulator has never grasped before.

A Graph-Based Deep Reinforcement Learning Approach to Grasping Fully Occluded Objects

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Visual-Based Deep Reinforcement Learning for Robot Grasping with Pushing

A Deep Learning Approach to Grasping the Invisible

Deep Reinforcement Learning-Based Robotic Grasping in Clutter and Occlusion

Synergistic Pushing and Grasping for Enhanced Robotic Manipulation Using Deep Reinforcement Learning

Reinforcement Learning Based Pushing and Grasping Objects from Ungraspable Poses

Efficient-Learning Grasping and Pushing in Dense Stacking Via Mask Function and Pixel Overlap Rate

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Grasping Unstructured Objects with Full Convolutional Network in Clutter

Robotic Arm Target Grasping Algorithm Based on Obstacle Removal in Space-Constrained Scenes

Robust Grasp Operation in Clutter for Multi-Objective Robotic Tasks Using Deep Reinforcement Learning

A pushing-grasping collaborative method based on deep Q-network algorithm in dual viewpoints

Grasp with Push Policy for Multi-Finger Dexterity Hand Based on Deep Reinforcement Learning☆

Position-aware pushing and grasping synergy with deep reinforcement learning in clutter

Collaborative Pushing and Grasping of Tightly Stacked Objects via Deep Reinforcement Learning

Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

Grasp Region Exploration for 7-Dof Robotic Grasping in Cluttered Scenes

Self-Supervised Learning for Joint Pushing and Grasping Policies in Highly Cluttered Environments

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.