Abstract:This paper presents a method for estimating the six Degrees of Freedom (6DoF) pose of texture-less objects from a monocular image by using edge information. The deep learning-based pose estimation method needs a large dataset containing pairs of an image and ground truth pose of objects. To alleviate the cost of collecting a dataset, we focus on the method using a dataset made by computer graphics (CG). This simulation-based method prepares a thousand images by rendering the computer-aided design (CAD) data of the object and trains a deep-learning model. As an inference stage, a monocular RGB image is entered into the model, and the object's pose is estimated. The representative simulation-based method, Pose Interpreter Networks, uses silhouette images as the input, thereby enabling common feature (contour) extraction from RGB and CG images. However, estimating rotation parameters is less accurate. To overcome this problem, we propose a method to use edge information extracted from the object's ridgelines for training the deep learning model. Since edge distribution changes largely according to the pose, the estimation of rotation parameters becomes more robust. Through an experiment with simulation data, we quantitatively proved the accuracy improvement compared to the previous method (error rate decreases at a certain condition are translation 22.9% and rotation: 43.4%). Moreover, through an experiment with physical data, we clarified the issues of this method and proposed an effective solution by fine-tuning (error rate decrease at a certain condition are translation 20.1% and rotation 57.7%).

Accurate 6DOF Pose Tracking for Texture-Less Objects

A Direct 3D Object Tracking Method Based on Dynamic Textured Model Rendering and Extended Dense Feature Fields

Robust Edge-Based 3D Object Tracking with Direction-Based Pose Validation.

Cross-domain Fusion and Embedded Refinement-Based 6D Object Pose Tracking on Textureless Objects

Pose Optimization in Edge Distance Field for Textureless 3D Object Tracking.

Accurate Pose Estimation of the Texture-Less Objects with Known CAD Models Via Point Cloud Matching

A Multi-stage 6D Object Pose Estimation Method of Texture-less Objects Based on Sparse Line Features

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Fast and precise 6D pose estimation of textureless objects using the point cloud and gray image

Tracking Randomly Moving Objects on Edge Box Proposals

6DOF pose estimation of a 3D rigid object based on edge-enhanced point pair features

6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting

Robust Monocular Model-Based Pose Tracking of Markerless Rigid Objects

An Occlusion‐aware Edge‐Based Method for Monocular 3D Object Tracking Using Edge Confidence

ER-Pose: Learning Edge Representation for 6D Pose Estimation of Texture-Less Objects.

3D Object Tracking for Rough Models.

Object Pose Estimation Using Edge Images Synthesized from Shape Information

Robust Monocular Object Pose Tracking for Large Pose Shift Using 2D Tracking

Deep Active Contours for Real-time 6-Dof Object Tracking

Robust Monocular Pose Tracking of Less-Distinct Objects Based on Contour-Part Model