Abstract:The point cloud feature aggregation, which learns discriminative features from the disordered points, plays a key role for large-scale point cloud semantic segmentation. Most previous aggregation methods are based on sampling a representative point subset, i.e., by a carefully designed point density metric, facing expensive computation cost especially for large-scale point clouds. Even though speeding up the point sampling process is studied by several recent works, but the component points in the sampled subset are uncertain and may change randomly, thus leading to corrupted geometric structure and discarded edges for representing an object. Therefore, we propose the DCNet, which consists of a fast point random sampling based encoder-decoder structure and several fully connected layers for semantic segmentation. To overcome the key feature loss caused by random down-sampling, the DCNet develops two novel local feature aggregation schemes: Double attention and Consistent constraints, to learn features that are discriminative for the challenging scenarios as above. The former considers both topological and semantic similarity of neighboring points to generate attention features for discriminating classes with similar geometric structures. The latter develops class-consistent constraints between adjacent layers in the decoder stage, to guide each point to aggregate with high-level semantic features of points belonging to the same class from the previous layer, which is beneficial for distinguishing neighboring points of the same class on the boundary. We conduct experiments and compare the proposed DCNet with existing methods on two benchmarks S3DIS and Semantic3D. Experiments show that the mean Intersection-over-Union (mIoU) of our method outperforms state-of-the-art methods by 2-3%, based on the same fast random sampling, and is also comparable to latest sampling-slower but accuracy-higher methods. That is, our method achieves the optimal speed-accuracy trade-off in the field of point cloud segmentation.

Unsupervised Semantic-Based Aggregation of Deep Convolutional Features

Unsupervised Semantic-Based Aggregation of Deep Convolutional Features

Unsupervised Semantic-Based Convolutional Features Aggregation for Image Retrieval

Weakly Supervised Soft-detection-based Aggregation Method for Image Retrieval.

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Unsupervised Part-based Weighting Aggregation of Deep Convolutional Features for Image Retrieval

Image retrieval based on aggregated deep features weighted by regional significance and channel sensitivity

Adversarial Soft-detection-based Aggregation Network for Image Retrieval

Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval

All-Higher-Stages-In Adaptive Context Aggregation for Semantic Edge Detection

Backward Attentive Fusing Network With Local Aggregation Classifier for 3D Point Cloud Semantic Segmentation

Rethinking feature aggregation for deep RGB-D salient object detection

Semantic-Consistency-guided Learning on Deep Features for Unsupervised Salient Object Detection

Semantic-Aware Context Aggregation for Image Inpainting

Salient object detection by aggregating contextual information

Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation

SALA: Soft Assignment Local Aggregation for Parameter Efficient 3D Semantic Segmentation

SSA: semantic structure aware inference on CNN networks for weakly pixel-wise dense predictions without cost

Weakly Supervised Semantic Segmentation of Point Cloud Scenes Using Boundary-based Feature Aggregation

DCNet: Large-Scale Point Cloud Semantic Segmentation with Discriminative and Efficient Feature Aggregation

Attention-based Dual Context Aggregation for Image Semantic Segmentation