Abstract:Three-dimensional LiDAR systems that capture point cloud data enable the simultaneous acquisition of spatial geometry and multi-wavelength intensity information, thereby paving the way for three-dimensional point cloud recognition and processing. However, due to the irregular distribution, low resolution of point clouds, and limited spatial recognition accuracy in complex environments, inherent errors occur in classifying and segmenting the acquired target information. Conversely, two-dimensional visible light images provide real-color information, enabling the distinction of object contours and fine details, thus yielding clear, high-resolution images when desired. The integration of two-dimensional information with point clouds offers complementary advantages. In this paper, we present the incorporation of two-dimensional information to form a multi-modal representation. From this, we extract local features to establish three-dimensional geometric relationships and two-dimensional color relationships. We introduce a novel network model, termed MInet (Multi-Information net), which effectively captures features relating to both two-dimensional color and three-dimensional pose information. This enhanced network model improves feature saliency, thereby facilitating superior segmentation and recognition tasks. We evaluate our MInet architecture using the ShapeNet and ThreeDMatch datasets for point cloud segmentation, and the Stanford dataset for object recognition. The robust results, coupled with quantitative and qualitative experiments, demonstrate the superior performance of our proposed method in point cloud segmentation and object recognition tasks.

Object Recognition of Three-dimensional SAR Based on PointNet

An 3D Point Cloud Reconstruction Approach from Single Image for Smart Power Plant

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

PC-Net: A Deep Network for 3D Point Clouds Analysis.

Deep Neural Network for Point Sets Based on Local Feature Integration

DeepICP: An End-to-End Deep Neural Network for 3D Point Cloud Registration

3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-Lmnet from Single Image

Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

2D&3DHNet for 3D Object Classification in LiDAR Point Cloud

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

PointpartNet: 3D point-cloud registration via deep part-based feature extraction

SP-Net: A Sparse Convolution and Point-Encoding Enhanced Network for 3D Object Detection in LiDAR Point Clouds.

Position-Feature Attention Network-Based Approach for Semantic Segmentation of Urban Building Point Clouds from Airborne Array Interferometric SAR

A New Semantic Segmentation Method of Point Cloud Based on PointNet and VoxelNet

3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network

Semantic segmentation of 3D indoor LiDAR point clouds through feature pyramid architecture search

PCRNet: Point Cloud Registration Network using PointNet Encoding

3D Object Classification with Point Convolution Network

3D Point Cloud Target Detection Method Based on R-PointGNN

Discriminative Learning of Point Cloud Feature Descriptors Based on Siamese Network.