Abstract:Background: The development of laser measurement techniques is of great significance in forestry monitoring and park management in smart cities. It provides many conveniences for improving landscape planning efficiency and strengthening digital construction. However, capturing 3D point clouds in large-scale landscape environments is a complex task that generates massive amounts of unstructured data with characteristics such as randomness, rotational invariance, sparsity, and serious barriers. Methods: To improve the processing efficiency of intelligent devices for massive point clouds, we propose a novel deep learning neural network based on a multi-feature aggregation strategy. This network is designed to divide 3D laser point clouds in complex large-scale scenarios. Firstly, we utilize multiple terrestrial laser sensors to collect a large amount of data in open scenes such as parks, streets, and forests in urban environments. These data are integrated into a practical database called DMSdataset, which contains different information variables, densities, and dimensions. Then, an automatic block integrated with a multi-feature extractor is constructed to pre-process the unstructured point cloud data and standardize the datasets. Finally, a novel semantic segmentation framework called PointDMS is designed using 3D convolutional deep networks. PointDMS achieves a better segmentation performance of point clouds with a lightweight parameter structure. Here, “D” stands for deep network, “M” stands for multi-feature, and “S” stands for segmentation. Results: Extensive experiments on self-built datasets show that the proposed PointDMS achieves similar or better performance in point cloud segmentation compared to other methods. The overall identification accuracy of the proposed model is up to 93.5%, which is a 14% increase. Particularly for living wood objects, the average identification accuracy is up to 88.7%, which is, at least, an 8.2% increase. These results effectively prove that PointDMS is beneficial for 3D point cloud processing, division, and mining applications in urban forest environments. It demonstrates good robustness and generalization.

Improving Deep Learning on Point Cloud by Maximizing Mutual Information Across Layers

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

PointMTL: Multi-Transform Learning for Effective 3D Point Cloud Representations

MMI-ML: Maximize Mutual Information Between Different Views for Few-Shot Remote Sensing Image Classification

PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling

PointMCD: Boosting Deep Point Cloud Encoders via Multi-view Cross-modal Distillation for 3D Shape Recognition

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding

Enriching Point Clouds with Implicit Representations for 3D Classification and Segmentation

PointDMS: An Improved Deep Learning Neural Network via Multi-Feature Aggregation for Large-Scale Point Cloud Segmentation in Smart Applications of Urban Forestry Management

Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

MSIDA-Net: Point Cloud Semantic Segmentation via Multi-Spatial Information and Dual Adaptive Blocks

Semantic Feature Mining for 3D Object Classification and Segmentation.

MMFN: Multimodal Information Fusion Networks for 3D Model Classification and Retrieval

Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

Deep Neighborhood-preserving Hashing with Quadratic Spherical Mutual Information for Cross-modal Retrieval

Applying Collaborative Adversarial Learning to Blind Point Cloud Quality Measurement

Pointwise Geometric and Semantic Learning Network on 3D Point Clouds.

Multi-Scale Neighborhood Feature Extraction and Aggregation for Point Cloud Segmentation

An attention-based bilateral feature fusion network for 3D point cloud