Abstract:Semantic segmentation based on LiDAR plays an important role in the environment perception, path planning, and decision control of unmanned ground systems. However, in challenging environments with complex background interleaving, the high proportion of drivable areas and significant target elements pose serious challenges to segmentation tasks. Existing studies attempt to address these challenges but still grapple with issues such as interclass semantic conflicts and inaccurate edge segmentation. To address these challenges effectively, a reliable point cloud segmentation network driven by multiview fusion and multiedge guidance is specially customized. Specifically, the network's point cloud multiview range image view (RIV) and bird's eye view (BEV) encoding backbones use lightweight pyramid architectures to extract specific details and semantic features of multiscale point clouds. Subsequently, a dedicated multiview edge guidance module focuses on enhancing interclass edge differentiation features from RIV and BEV, respectively. These features are fused with the encoding backbone hierarchy, and the extraction of edge information is supervised by a new hybrid edge loss to maximize the consistency of semantic segmentation and predicted edges. Furthermore, a multiview and multiscale feature fusion module based on a multihead attention mechanism is introduced to enhance the potential complementarity and interaction of the captured features. Through comprehensive experiments and ablation studies on the SemanticKITTI and RELLIS-3D datasets, recognized in the field of autonomous driving, the results demonstrate that our custom method is competitive in terms of intersection over union (IoU) accuracy and real-time indicators compared with typical baseline methods.

Accurate 3D Semantic Segmentation of Point Clouds for Intelligent Vehicles Based on Multi-view Edge Guidance and Fusion

Accurate 3-D Semantic Segmentation of Point Clouds for Intelligent Vehicles Based on Multiview Edge Guidance and Fusion

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Robust 3D Semantic Segmentation Based on Multi-Phase Multi-Modal Fusion for Intelligent Vehicles

Robust 3D Semantic Segmentation Method Based on Multi-Modal Collaborative Learning

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

Moving Object Segmentation Network for Multi-View Fusion of Vehicle-Mounted LiDAR

Scene-Adaptive 3-D Semantic Segmentation Method Based on Multiphase Edge Enhancement for Intelligent Vehicles

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

A Novel Real-Time Edge-Guided LiDAR Semantic Segmentation Network for Unstructured Environments

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

CLFusion:3D Semantic Segmentation Based on Camera and Lidar Fusion

Location-Guided LiDAR-Based Panoptic Segmentation for Autonomous Driving.

Ground-Aware Point Cloud Semantic Segmentation for Autonomous Driving

LiDAR-Based Real-Time Panoptic Segmentation via Spatiotemporal Sequential Data Fusion

A Multi-phase Camera-LiDAR Fusion Network for 3D Semantic Segmentation with Weak Supervision

Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

A Semantic-aided Fusion Localization Method for Intelligent Vehicles in GNSS-denied Dynamic Environments

Combined Edge- and Stixel-based Object Detection in 3D Point Cloud