Abstract:With sufficient practice, humans can grab objects they have never seen before through brain decision-making. However, the manipulators, which has a wide range of applications in industrial production, can still only grab specific objects. Because most of the grasp algorithms rely on prior knowledge such as hand-eye calibration results, object model features, and can only target specific types of objects. When the task scenario and the operation target change, it cannot perform effective redeployment. In order to solve the above problems, academia often uses reinforcement learning to train grasping algorithms. However, the method of reinforcement learning in the field of manipulators grasping mainly encounters these main problems: insufficient sample utilization, poor algorithm stability, and limited exploration. This article uses LfD, BC, and DDPG to improve sample utilization. Use multiple critics to integrate and evaluate input actions to solve the problem of algorithm instability. Finally, inspired by Thompson's sampling idea, the input action is evaluated from different angles, which increases the algorithm's exploration of the environment and reduces the number of interactions with the environment. EDDPG and EBDDPG algorithm is designed in the article. In order to further improve the generalization ability of the algorithm, this article does not use extra information that is difficult to obtain directly on the physical platform, such as the real coordinates of the target object and the continuous motion space at the end of the manipulator in the Cartesian coordinate system is used as the output of the decision. The simulation results show that, under the same number of interactions, the manipulators' success rate in grabbing 1000 random objects has increased more than double and reached state-of-the-art(SOTA) performance.

Learning to Dexterously Pick or Separate Tangled-Prone Objects for Industrial Bin Picking

Learning Efficient Policies for Picking Entangled Wire Harnesses: An Approach to Industrial Bin Picking

A closed-loop bin picking system for entangled wire harnesses using bimanual and dynamic manipulation

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

Fast and Robust Bin-picking System for Densely Piled Industrial Objects

Efficient 3D Object Recognition for Unadjusted Bin Picking Automation

Prehensile and Non-Prehensile Robotic Pick-and-Place of Objects in Clutter using Deep Reinforcement Learning

Suction Grasp Region Prediction Using Self-supervised Learning for Object Picking in Dense Clutter

Efficient End-to-End Detection of 6-DoF Grasps for Robotic Bin Picking

Learning Extrinsic Dexterity with Parameterized Manipulation Primitives

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

An Industrial Bin Picking Framework for Assembly Tasks.

Multi-Object Grasping -- Generating Efficient Robotic Picking and Transferring Policy

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Bin-picking of novel objects through category-agnostic-segmentation: RGB matters

DoraPicker: An Autonomous Picking System for General Objects

Robotic Untangling of Herbs and Salads with Parallel Grippers

Learning Tri-mode Grasping for Ambidextrous Robot Picking

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

Towards One Shot & Pick All: 3D-OAS, an end-to-end framework for vision guided top-down parcel bin-picking using 3D-overlapping-aware instance segmentation and GNN

Robot Learning of Shifting Objects for Grasping in Cluttered Environments