Abstract:In recent times, object detection and pose estimation have gained significant attention in the context of robotic vision applications. Both the identification of objects of interest as well as the estimation of their pose remain important capabilities in order for robots to provide effective assistance for numerous robotic applications ranging from household tasks to industrial manipulation. This problem is particularly challenging because of the heterogeneity of objects having different and potentially complex shapes, and the difficulties arising due to background clutter and partial occlusions between objects. As the main contribution of this work, we propose a system that performs real-time object detection and pose estimation, for the purpose of dynamic robot grasping. The robot has been pre-trained to perform a small set of canonical grasps from a few fixed poses for each object. When presented with an unknown object in an arbitrary pose, the proposed approach allows the robot to detect the object identity and its actual pose, and then adapt a canonical grasp in order to be used with the new pose. For training, the system defines a canonical grasp by capturing the relative pose of an object with respect to the gripper attached to the robot's wrist. During testing, once a new pose is detected, a canonical grasp for the object is identified and then dynamically adapted by adjusting the robot arm's joint angles, so that the gripper can grasp the object in its new pose. We conducted experiments using a humanoid PR2 robot and showed that the proposed framework can detect well-textured objects, and provide accurate pose estimation in the presence of tolerable amounts of out-of-plane rotation. The performance is also illustrated by the robot successfully grasping objects from a wide range of arbitrary poses.

Saliency Based Proposal Refinement in Robotic Vision

Refining Object Proposals Using Structured Edge and Superpixel Contrast in Robotic Grasping

Video Saliency Detection Using Object Proposals

An object planar grasping pose detection algorithm in low-light scenes

Saliency Guided Region Proposal

Feature Perception and Refinement Network for Salient Object Detection

A refined robotic grasp detection network based on coarse-to-fine feature and residual attention

A Vision-based Robot Grasping System

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

50 FPS Object-Level Saliency Detection Via Maximally Stable Region

Rethinking of the Image Salient Object Detection: Object-level Semantic Saliency Re-ranking First, Pixel-wise Saliency Refinement Latter

Co-Saliency Detection Via Local Prediction and Global Refinement.

Robust Saliency Detection via Fusing Foreground and Background Priors

Robotic Object Recognition And Grasping With A Natural Background

Deep Vision Networks for Real-Time Robotic Grasp Detection

S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes

Object Detection Method for Grasping Robot Based on Improved YOLOv5

Context-Aware Video Object Proposals.

Robot Manipulation in Salient Vision through Referring Image Segmentation and Geometric Constraints

Bilateral Cross-Modal Fusion Network for Robot Grasp Detection

Robotic Grasping Detection Algorithm Based on 3D Vision Dual-Stream Encoding Strategy