Abstract:Collaboration between Light Detection and Ranging (LiDAR) point clouds and deep learning has been proven to be an effective approach for vegetation mapping. Current studies have predominantly focused on 2D vegetation mapping, whereas 3D mapping, which directly classifies point clouds at point level, offers a more comprehensive understanding of the stratified structural information of vegetation. However, there is a lack of research on 3D vegetation species mapping, and the disparities between 2D and 3D mapping in natural scenarios remain unclear. To resolve these issues, we compared the deep learning performance of 2D and 3D vegetation species mapping across three distinct natural scenes: karst wetland, mangrove forest, and hill forest. In addition, the 2D and 3D mapping in natural scenes are adversely affected by the elevated channel count of LiDAR-derived features and the extreme category imbalance in point cloud. To mitigate these challenges, we propose a novel Multi-resolution Feature Selection Network (MrFSNet) to select optimal feature combinations at different scales for better 2D mapping performance. Additionally, we introduce a novel Dynamic Weighted Sampling (DWS) strategy, which is combined with KPConv to address the extreme category imbalance present in 3D mapping. Results indicate that: (1) 3D vegetation species mapping exhibited the highest performance, achieving an mF1 of 89.78% for karst wetland, 92.25% for mangrove forest, and 92.05% for hill forest. (2) 3D mapping outperformed 2D mapping, improving mF1 by 3.43% to 27.08%. (3) MrFSNet adaptively extracted optimal features at various scales and performed well with the limited training data in 2D vegetation mapping, resulting in a 1.66%–18.46% higher mF1 than that of Swin Transformer. (4) DWS effectively resolved the extreme category imbalance problem and produced 1.28%–2.80% higher mF1 than the non-DWS version in 3D vegetation mapping.

Imaging Lidar Based 3D Terrain Matching Using Feature Vector

Camera-Lidar-Based Terrain Multi-type Classification Using Both Spatial and Histogram Features of Lidars

Real-time and High Precision Feature Matching Between Blur Aerial Images

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

A Mars Local Terrain Matching Method Based on 3D Point Clouds

Matching error of the iterative closest contour point algorithm for terrain-aided navigation

Pairwise LIDAR Calibration Using Multi-Type 3D Geometric Features in Natural Scene.

Comparison of 2D and 3D vegetation species mapping in three natural scenarios using UAV-LiDAR point clouds and improved deep learning methods

Real-Time 3D Mapping in Complex Environments Using a Spinning Actuated LiDAR System

3D SLAM based on NDT matching and ground constraints for ground robots in complex environments

An Improved ICCP-Based Underwater Terrain Matching Algorithm for Large Initial Position Error

Application of Image Matching to Seabed Terrain Map

Research on 3D LiDAR Point Cloud Matching Localization Method

The Algorithm of Multi-path Terrain Contour Matching Based on Laser Radar

INS/GPS/LiDAR Integrated Navigation System for Urban and Indoor Environments Using Hybrid Scan Matching Algorithm

3D Lidar Mapping Relative Accuracy Automatic Evaluation Algorithm

Statistical Terrain Model with Geometric Feature Detection Based on GPU Using LiDAR on Vehicles

Pit slope unmanned aerial vehicle image matching based on hybrid scale space and boosted efficient binary local image descriptor

A Heterogeneous Remote Sensing Image Matching Method for Urban Areas With Complex Terrain Based on 3D Spatial Relationship Constraints

3D ONLINE TERRAIN MAPPING WITH SCANNING RADAR SENSORS

Efficient Feature Extraction and Localizability Based Matching for Lidar SLAM