Abstract:We focus on the task of goal-oriented grasping, in which a robot is supposed to grasp a pre-assigned goal object in clutter and needs some pre-grasp actions such as pushes to enable stable grasps. However, in this task, the robot gets positive rewards from environment only when successfully grasping the goal object. Besides, joint pushing and grasping elongates the action sequence, compounding the problem of reward delay. Thus, sample inefficiency remains a main challenge in this task. In this paper, a goal-conditioned hierarchical reinforcement learning formulation with high sample efficiency is proposed to learn a push-grasping policy for grasping a specific object in clutter. In our work, sample efficiency is improved by two means. First, we use a goal-conditioned mechanism by goal relabeling to enrich the replay buffer. Second, the pushing and grasping policies are respectively regarded as a generator and a discriminator and the pushing policy is trained with supervision of the grasping discriminator, thus densifying pushing rewards. To deal with the problem of distribution mismatch caused by different training settings of two policies, an alternating training stage is added to learn pushing and grasping in turn. A series of experiments carried out in simulation and real world indicate that our method can quickly learn effective pushing and grasping policies and outperforms existing methods in task completion rate and goal grasp success rate by less times of motion. Furthermore, we validate that our system can also adapt to goal-agnostic conditions with better performance. Note that our system can be transferred to the real world without any fine-tuning. Our code is available at <a class="link-external link-https" href="https://github.com/xukechun/Efficient_goal-oriented_push-grasping_synergy" rel="external noopener nofollow">this https URL</a>.

Efficient-Learning Grasping and Pushing in Dense Stacking Via Mask Function and Pixel Overlap Rate

Efficient push-grasping for multiple target objects in clutter environments

Ensemble Bootstrapped Deep Deterministic Policy Gradient For Vision-Based Robotic Grasping

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Collaborative Pushing and Grasping of Tightly Stacked Objects via Deep Reinforcement Learning

Efficient learning of goal-oriented push-grasping synergy in clutter

Self-Supervised Learning for Joint Pushing and Grasping Policies in Highly Cluttered Environments

Gated Self Attention Network for Efficient Grasping of Target Objects in Stacked Scenarios

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

Learning Dual-Arm Push and Grasp Synergy in Dense Clutter

Synergistic Pushing and Grasping for Enhanced Robotic Manipulation Using Deep Reinforcement Learning

A Graph-Based Deep Reinforcement Learning Approach to Grasping Fully Occluded Objects

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.

Reinforcement Learning Based Pushing and Grasping Objects from Ungraspable Poses

Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

Robotic Arm Target Grasping Algorithm Based on Obstacle Removal in Space-Constrained Scenes

GE-Grasp: Efficient Target-Oriented Grasping in Dense Clutter

Position-aware pushing and grasping synergy with deep reinforcement learning in clutter

Towards Robotic Picking of Targets with Background Distractors using Deep Reinforcement Learning

An Efficient and Stable Grasp Planning Method for Stacked Parts

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects