Abstract:In recent times, object detection and pose estimation have gained significant attention in the context of robotic vision applications. Both the identification of objects of interest as well as the estimation of their pose remain important capabilities in order for robots to provide effective assistance for numerous robotic applications ranging from household tasks to industrial manipulation. This problem is particularly challenging because of the heterogeneity of objects having different and potentially complex shapes, and the difficulties arising due to background clutter and partial occlusions between objects. As the main contribution of this work, we propose a system that performs real-time object detection and pose estimation, for the purpose of dynamic robot grasping. The robot has been pre-trained to perform a small set of canonical grasps from a few fixed poses for each object. When presented with an unknown object in an arbitrary pose, the proposed approach allows the robot to detect the object identity and its actual pose, and then adapt a canonical grasp in order to be used with the new pose. For training, the system defines a canonical grasp by capturing the relative pose of an object with respect to the gripper attached to the robot's wrist. During testing, once a new pose is detected, a canonical grasp for the object is identified and then dynamically adapted by adjusting the robot arm's joint angles, so that the gripper can grasp the object in its new pose. We conducted experiments using a humanoid PR2 robot and showed that the proposed framework can detect well-textured objects, and provide accurate pose estimation in the presence of tolerable amounts of out-of-plane rotation. The performance is also illustrated by the robot successfully grasping objects from a wide range of arbitrary poses.

OptiGrasp: Optimized Grasp Pose Detection Using RGB Images for Warehouse Picking Robots

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

A Robotic Semantic Grasping Method for Pick-and-place Tasks

RGBGrasp: Image-based Object Grasping by Capturing Multiple Views during Robot Arm Movement with Neural Radiance Fields

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Efficient End-to-End Detection of 6-DoF Grasps for Robotic Bin Picking

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

SparseGrasp: Robotic Grasping via 3D Semantic Gaussian Splatting from Sparse Multi-View RGB Images

A Vision-based Robot Grasping System

Lightweight Pixel-Wise Generative Robot Grasping Detection Based on RGB-D Dense Fusion

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

A Novel RGB-D Cross-Background Robot Grasp Detection Dataset and Background-Adaptive Grasping Network

Grasp Pose Detection from a Single RGB Image

SG-Grasp: Semantic Segmentation Guided Robotic Grasp Oriented to Weakly Textured Objects Based on Visual Perception Sensors

High-performance Pixel-level Grasp Detection Based on Adaptive Grasping and Grasp-aware Network

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction