Abstract:We propose a single-shot method for simultaneous 3D object segmentation and 6-DOF pose estimation in pure 3D point clouds scenes based on a consensus that \emph{one point only belongs to one object}, i.e., each point has the potential power to predict the 6-DOF pose of its corresponding object. Unlike the recently proposed methods of the similar task, which rely on 2D detectors to predict the projection of 3D corners of the 3D bounding boxes and the 6-DOF pose must be estimated by a PnP like spatial transformation method, ours is concise enough not to require additional spatial transformation between different dimensions. Due to the lack of training data for many objects, the recently proposed 2D detection methods try to generate training data by using rendering engine and achieve good results. However, rendering in 3D space along with 6-DOF is relatively difficult. Therefore, we propose an augmented reality technology to generate the training data in semi-virtual reality 3D space. The key component of our method is a multi-task CNN architecture that can simultaneously predicts the 3D object segmentation and 6-DOF pose estimation in pure 3D point clouds. For experimental evaluation, we generate expanded training data for two state-of-the-arts 3D object datasets \cite{PLCHF}\cite{TLINEMOD} by using Augmented Reality technology (AR). We evaluate our proposed method on the two datasets. The results show that our method can be well generalized into multiple scenarios and provide performance comparable to or better than the state-of-the-arts.

Space-Time Co-Segmentation Of Articulated Point Cloud Sequences

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Scene Segmentation and Understanding for Context-Free Point Clouds

Motion Objects Segmentation Using a New Level Set Based Method

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

Spatio-temporal Segmentation Based Adaptive Compression of Dynamic Mesh Sequences

Co-segmentation of 3D Shapes Via Multi-View Spectral Clustering

An Automatic Segmentation Algorithm for Dense Pipeline Point Cloud Data

Robust Trajectory Clustering for Motion Segmentation

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Co-Segmentation of 3D Shapes Via Subspace Clustering.

Robust Multi-Body Motion Segmentation Based on Fuzzy K-Subspace Clustering

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

Motion Segmentation Via Robust Subspace Separation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

FusionSeg: Motion Segmentation by Jointly Exploiting Frames and Events

One Point, One Object: Simultaneous 3D Object Segmentation and 6-DOF Pose Estimation

Human Segmentation with Dynamic LiDAR Data