Abstract:6-D object pose estimation is widely used in the robotic grasp, and a series of object pose estimation methods have been proposed. Among them, category-level object pose estimation methods are widely researched in recent years. Category-level object pose estimation is mainly used to estimate the pose of unknown objects in the same class, and has been used in robotic grasping and augmented reality. Most of the current methods tend to rely on large datasets as well as labels, which pose challenges. To address this problem, a new category-level object pose estimation network, SCNet, is proposed, which not only enables the network to transfer from the simulation environment to the real world but also allows us to train the network with a self-supervised learning way, which can well compensate for the lack of large-scale labeled datasets. Since the network lacks 3-D models of unknown objects, we introduce the prior point cloud of objects in the same category and propose a deformation module based on RGB images and the prior point cloud, which enables the prior point cloud to be well deformed into target objects in the scene. Moreover, a transformer-based recurrent refinement module is proposed to further refine the deformation structure to better fit target objects. We have performed evaluation experiments on CAMERA25 dataset and REAL275 dataset, and our experimental results show that the proposed method outperforms current self-supervised category-based pose estimation methods, and outperforms some supervised category pose estimation methods. Finally, we apply the SCNet to the object pose estimation in the real world, and perform a series of robotic grasp tasks on a Baxter robot.

Grasping Pose Detection for Loose Stacked Object Based on Convolutional Neural Network with Multiple Self-Powered Sensors Information

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

A grasping posture estimation method based on 3D detection network

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes

An Efficient Grasp Pose Detection Method Based on Point-PN

Gated Self Attention Network for Efficient Grasping of Target Objects in Stacked Scenarios

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

Robot Grasping Based on Stacked Object Classification Network and Grasping Order Planning

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios

A Semantic Robotic Grasping Framework Based on Multi-Task Learning in Stacking Scenes.

Multitarget Flexible Grasping Detection Method for Robots in Unstructured Environments

Pixel-Level Grasp Detection for Unknown Objects with Encoder-Decoder-Inception Deep Network

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

Robotic Grasp Detection Based on Category-Level Object Pose Estimation with Self-Supervised Learning

Robotic Grasping in Multi-Object Stacking Scenes Based on Visual Reasoning