Abstract:This paper addresses the challenge of perceiving complete object shapes through visual perception. While prior studies have demonstrated encouraging outcomes in segmenting the visible parts of objects within a scene, amodal segmentation, in particular, has the potential to allow robots to infer the occluded parts of objects. To this end, this paper introduces a new framework that explores amodal segmentation for robotic grasping in cluttered scenes, thus greatly enhancing robotic grasping abilities. Initially, we use a conventional segmentation algorithm to detect the visible segments of the target object, which provides shape priors for completing the full object mask. Particularly, to explore how to utilize semantic features from RGB images and geometric information from depth images, we propose a Linear-fusion Attention-guided Convolutional Network (LAC-Net). LAC-Net utilizes the linear-fusion strategy to effectively fuse this cross-modal data, and then uses the prior visible mask as attention map to guide the network to focus on target feature locations for further complete mask recovery. Using the amodal mask of the target object provides advantages in selecting more accurate and robust grasp points compared to relying solely on the visible segments. The results on different datasets show that our method achieves state-of-the-art performance. Furthermore, the robot experiments validate the feasibility and robustness of this method in the real world. Our code and demonstrations are available on the project page: <a class="link-external link-https" href="https://jrryzh.github.io/LAC-Net" rel="external noopener nofollow">this https URL</a>.

A Grasp Pose Detection Network Based on the DeepLabv3+Semantic Segmentation Model

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

A grasping posture estimation method based on 3D detection network

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

Joint Segmentation and Grasp Pose Detection with Multi-Modal Feature Fusion Network.

Simulation and Deep Learning on Point Clouds for Robot Grasping

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Detection Method of Manipulator Grasp Pose Based on RGB-D Image

Unseen Object Few-Shot Semantic Segmentation for Robotic Grasping

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

A Vision-based Robot Grasping System

Deep Vision Networks for Real-Time Robotic Grasp Detection

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

Robotic grasping using visual and tactile sensing

A pixel-level grasp detection method based on Efficient Grasp Aware Network

LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

Grasp Pose Detection from a Single RGB Image

SUGrasping: a Semantic Grasping Framework Based on Multi-Head 3D U-Net

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

SegGrasp: Zero-Shot Task-Oriented Grasping via Semantic and Geometric Guided Segmentation