Abstract:Accurate 3D object segmentation in point clouds is a basis for industrial robot applications, such as robot manipulation and digital twin, which require an understanding of the 3D environment. However, the unstructured and disordered nature of point clouds makes it challenging, especially for the incomplete 3D data under a single view in the real-world scenario. To this end, this paper proposes a novel 3D object segmentation framework (3DT-Seg) based on Cross-Window Point Transformer (CP-Former). CP-Former captures the long-range dependencies between local windows and latent semantic boundaries to enhance the point-wise features extracted from irregular point clouds via a bidirectional cross-attention mechanism. In addition, a contrastive learning loss and an adaptive dual aggregation strategy are introduced on semantic transition regions during the semantic supervising and instance clustering process, respectively. In this way, the latent boundary information is further utilized to improve the overall segmentation performance. Experiments on the popular benchmark (SI3DS) dataset show the state-of-the-art performance of the proposed approach in terms of semantic and instance segmentation. Furthermore, a real-world point cloud dataset (IP-Cloud) for the robotic grasping task is presented to fully validate the effectiveness of our method in practice, where it also achieves remarkable performance.

3D Scene Segmentation with a Shape Repository

3D mesh segmentation using a two-stage merging strategy

3D Reconstruction Based on Image Segmentation

3D Human Landmark Detection and Segmentation with Semantic Knowledge

A novel segmentation algorithm for complex 3D mesh model in computer vision.

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Scene Segmentation and Understanding for Context-Free Point Clouds

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Efficient point cloud segmentation approach using energy optimization with geometric features for 3D scene understanding

User-controllable Mesh Segmentation Using Shape Harmonic Signature

Mesh Segmentation Based on 3D Delaunay Triangulation

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

Supervoxel-based 3D Segmentation in Complex Scenes

Co-Segmentation of 3D Shapes Via Subspace Clustering.

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

3D Shape Segmentation Via Attentive Nonuniform Downsampling

Robust Mesh Segmentation Using Feature-Aware Region Fusion

iSeg3D: An Interactive 3D Shape Segmentation Tool

Volumetric Segmentation Of 3d Mesh Models