Abstract:The point cloud feature aggregation, which learns discriminative features from the disordered points, plays a key role for large-scale point cloud semantic segmentation. Most previous aggregation methods are based on sampling a representative point subset, i.e., by a carefully designed point density metric, facing expensive computation cost especially for large-scale point clouds. Even though speeding up the point sampling process is studied by several recent works, but the component points in the sampled subset are uncertain and may change randomly, thus leading to corrupted geometric structure and discarded edges for representing an object. Therefore, we propose the DCNet, which consists of a fast point random sampling based encoder-decoder structure and several fully connected layers for semantic segmentation. To overcome the key feature loss caused by random down-sampling, the DCNet develops two novel local feature aggregation schemes: Double attention and Consistent constraints, to learn features that are discriminative for the challenging scenarios as above. The former considers both topological and semantic similarity of neighboring points to generate attention features for discriminating classes with similar geometric structures. The latter develops class-consistent constraints between adjacent layers in the decoder stage, to guide each point to aggregate with high-level semantic features of points belonging to the same class from the previous layer, which is beneficial for distinguishing neighboring points of the same class on the boundary. We conduct experiments and compare the proposed DCNet with existing methods on two benchmarks S3DIS and Semantic3D. Experiments show that the mean Intersection-over-Union (mIoU) of our method outperforms state-of-the-art methods by 2-3%, based on the same fast random sampling, and is also comparable to latest sampling-slower but accuracy-higher methods. That is, our method achieves the optimal speed-accuracy trade-off in the field of point cloud segmentation.

A Large-Scale Point Cloud Semantic Segmentation Network Via Local Dual Features and Global Correlations

Dual-scale Point Cloud Completion Network Based on High-Frequency Feature Fusion

Large-scale point cloud semantic segmentation via local perception and global descriptor vector

A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Dual fusion network for semantic segmentation of point clouds

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

A large-scale point cloud semantic segmentation neural network based on long-range contextual dependencies enhancement

DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds

SWCF-Net: Similarity-weighted Convolution and Local-global Fusion for Efficient Large-scale Point Cloud Semantic Segmentation

LDCNet: Long-Distance Context Modeling for Large-Scale 3D Point Cloud Scene Semantic Segmentation

MSIDA-Net: Point Cloud Semantic Segmentation via Multi-Spatial Information and Dual Adaptive Blocks

FA-ResNet: Feature affine residual network for large-scale point cloud segmentation

MLFNet- Point Cloud Semantic Segmentation Convolution Network Based on Multi-Scale Feature Fusion

LLGF-Net: Learning Local and Global Feature Fusion for 3D Point Cloud Semantic Segmentation

DCNet: Large-Scale Point Cloud Semantic Segmentation with Discriminative and Efficient Feature Aggregation

LEARD-Net: Semantic segmentation for large-scale point cloud scene

Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation

SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation.