Abstract:Estimating 6D poses and reconstructing 3D shapes of objects in open-world scenes from RGB-depth image pairs is challenging. Many existing methods rely on learning geometric features that correspond to specific templates while disregarding shape variations and pose differences among objects in the same category. As a result, these methods underperform when handling unseen object instances in complex environments. In contrast, other approaches aim to achieve category-level estimation and reconstruction by leveraging normalized geometric structure priors, but the static prior-based reconstruction struggles with substantial intra-class variations. To solve these problems, we propose the DTF-Net, a novel framework for pose estimation and shape reconstruction based on implicit neural fields of object categories. In DTF-Net, we design a deformable template field to represent the general category-wise shape latent features and intra-category geometric deformation features. The field establishes continuous shape correspondences, deforming the category template into arbitrary observed instances to accomplish shape reconstruction. We introduce a pose regression module that shares the deformation features and template codes from the fields to estimate the accurate 6D pose of each object in the scene. We integrate a multi-modal representation extraction module to extract object features and semantic masks, enabling end-to-end inference. Moreover, during training, we implement a shape-invariant training strategy and a viewpoint sampling method to further enhance the model's capability to extract object pose features. Extensive experiments on the REAL275 and CAMERA25 datasets demonstrate the superiority of DTF-Net in both synthetic and real scenes. Furthermore, we show that DTF-Net effectively supports grasping tasks with a real robot arm.

TFENet: Topological Feature Extraction Network for 6D Object Pose Estimation

FEIF: Feature Excitation and Interactive Fusion for 6D Object Pose Estimation.

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field

A Transformer-based multi-modal fusion network for 6D pose estimation

FGCT6D: Frequency-Guided CNN-Transformer Fusion Network for Metal Parts' Robust 6D Pose Estimation

LHFF-Net: Local heterogeneous feature fusion network for 6DoF pose estimation

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

6D Object Pose Estimation Based on Cross-Modality Feature Fusion

TFIENet: Transformer Fusion Information Enhancement Network for Multi-Model 3D Object Detection

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

TFIENet: Transformer Fusion Information Enhancement Network for Multimodel 3-D Object Detection.

A Novel Depth and Color Feature Fusion Framework for 6D Object Pose Estimation.

KGNet: Knowledge-Guided Networks for Category-Level 6D Object Pose and Size Estimation.

DON6D: a decoupled one-stage network for 6D pose estimation

A RGB-D Based 6D Object Pose Estimation and Its Application in Robotic Grasping

Point Pair Feature Based 6D Pose Estimation for Robotic Grasping

HFF6D: Hierarchical Feature Fusion Network for Robust 6D Object Pose Tracking

PANet: A Pixel-Level Attention Network for 6D Pose Estimation With Embedding Vector Features

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Triangulate Geometric Constraint Combined with Visual-Flow Fusion Network for Accurate 6dof Pose Estimation.