Abstract:Accurate 3D object segmentation in point clouds is a basis for industrial robot applications, such as robot manipulation and digital twin, which require an understanding of the 3D environment. However, the unstructured and disordered nature of point clouds makes it challenging, especially for the incomplete 3D data under a single view in the real-world scenario. To this end, this paper proposes a novel 3D object segmentation framework (3DT-Seg) based on Cross-Window Point Transformer (CP-Former). CP-Former captures the long-range dependencies between local windows and latent semantic boundaries to enhance the point-wise features extracted from irregular point clouds via a bidirectional cross-attention mechanism. In addition, a contrastive learning loss and an adaptive dual aggregation strategy are introduced on semantic transition regions during the semantic supervising and instance clustering process, respectively. In this way, the latent boundary information is further utilized to improve the overall segmentation performance. Experiments on the popular benchmark (SI3DS) dataset show the state-of-the-art performance of the proposed approach in terms of semantic and instance segmentation. Furthermore, a real-world point cloud dataset (IP-Cloud) for the robotic grasping task is presented to fully validate the effectiveness of our method in practice, where it also achieves remarkable performance.

A new segmentation method for point cloud data

Edge-based Segmentation of Point Cloud Data

3D Surface Segmentation from Point Clouds Via Quadric Fits Based on DBSCAN Clustering

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Planar Point Cloud Segmentation Based on Edge Point Extraction and Redistribution

GEOMETRIC ATTRIBUTE ANALYSIS AND SEGMENTATION OF POINT CLOUD

A Point Cloud Segmentation Algorithm Using Local Convexity and Octree

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

A novel segmentation algorithm for complex 3D mesh model in computer vision.

An Efficient Method to Mesh Point Cloud

Facet-Growing Approach to Point Cloud Segmentation Using Local Convexity and Octree

Research on Point Cloud Data Segmentation in Surface Reconstruction

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Scene Segmentation and Understanding for Context-Free Point Clouds

Review of 3D Point Cloud Data Segmentation Methods

A Point Cloud Contour Extraction Method based on Plane Segmentation

Geometric Segmentation of 3D Scanned Surfaces for Multi-Sensor Coordinate Metrology

Quadric Feature Extraction from Points Cloud in Reverse Engineering

Supervoxel-Based Region Growing Segmentation for Point Cloud Data

Indoor Point Cloud segmentation using a modified region growing algorithm and accurate normal estimation

Enhanced Curve-Based Segmentation Method for Point Clouds of Curved and Irregular Structures