Abstract:The point cloud semantic segmentation plays a significant role in the understanding of 3D environment. However, current 3D point cloud segmentation methods pay little attention in the inevitable blurring and loss of point information within deep network, which considerably impairs the segmentation performance, particularly in the complex and colorful indoor scenes. To overcome the inevitable loss of point information (position, color and normal vector), in this paper, we propose a brand-new Information Encoding and Fusion Module (IEFM), comprising a point Information Encoding Method (IEM) and an optimized Multi-Encoding Fusion Method (EFM). In terms of constructing the innovative bias standardization of point information and effectively merging other information encodings into position encoding, IEFM adaptively complements the loss of the point information and thereby achieving enhanced environment perception ability. Additionally, although the proposed IEFM is capable of managing multi-class point information, the encoding interference resulting from the coexistence of multiple information is quite unavoidable, leading to detrimental consequences for the overall semantic segmentation performance. Therefore, to reduce the information encoding interference problem, we further innovatively propose the Information Distribution Strategy (IDS), in terms of hierarchically distribute kinds of point information, so that the interference of multiple information encodings will be extremely mitigated and achieving more accurate indoor point cloud semantic segmentation. Benefiting from the modular design, the proposed IEFM and IDS can be easily inserted in existing point-based point cloud segmentation models. The experimental results have shown the effectiveness of our proposed methods across multiple state-of-the-art models and benchmarks (S3DIS and ScanNet), achieving competitive performance of 77.4% mIoU on the large-scale S3DIS benchmark.

Instance-Aware Embedding for Point Cloud Instance Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Object Bounding Box-Aware Embedding for Point Cloud Instance Segmentation

3D Instance Embedding Learning with a Structure-Aware Loss Function for Point Cloud Segmentation.

Associatively Segmenting Instances and Semantics in Point Clouds

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Hierarchical Aggregation for 3D Instance Segmentation

OccuSeg: Occupancy-Aware 3D Instance Segmentation

Semantic Context Encoding for Accurate 3D Point Cloud Segmentation

ICM-3D: Instantiated Category Modeling for 3D Instance Segmentation

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Joint Semantic-Instance Segmentation of 3D Point Clouds: Instance Separation and Semantic Fusion.

Instance-aware 3D Semantic Segmentation powered by Shape Generators and Classifiers

Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentation

Data-efficient 3D instance segmentation by transferring knowledge from synthetic scans

Encoding Discriminative Representation for Point Cloud Semantic Segmentation

SAI3D: Segment Any Instance in 3D Scenes

IEFM and IDS: Enhancing 3D Environment Perception Via Information Encoding in Indoor Point Cloud Semantic Segmentation

EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation

SA3DIP: Segment Any 3D Instance with Potential 3D Priors

ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution