Abstract:Urban management and survey departments have begun investigating the feasibility ofacquiring data from various laser scanning systems for urban infrastructure measurements and assessments. Roadside objects such as cars, trees, traffic poles, pedestrians, bicycles and e-bicycles describe the static and dynamic urban information available for acquisition. Because of the unstructured nature of 3D point clouds, the rich targets in complex road scenes, and the varying scales of roadside objects, finely classifying these roadside objects from various point clouds is a challenging task. In this paper, we integrate two representations of roadside objects, point clouds and multiview images to propose a point-group-view network named PGVNet for classifying roadside objects into cars, trees, traffic poles, and small objects (pedestrians, bicycles and e-bicycles) from generalized point clouds. To utilize the topological information of the point clouds, we propose a graph attention convolution operation called AtEdgeConv to mine the relationship among the local points and to extract local geometric features. In addition, we employ a hierarchical view-group-object architecture to diminish the redundant information between similar views and to obtain salient viewwise global features. To fuse the local geometric features from the point clouds and the global features from multiview images, we stack an attention-guided fusion network in PGVNet. In particular, we quantify and leverage the global features as an attention mask to capture the intrinsic correlation and discriminability of the local geometric features, which contributes to recognizing the different roadside objects with similar shapes. To verify the effectiveness and generalization of our methods, we conduct extensive experiments on six test datasets of different urban scenes, which were captured by different laser scanning systems, including mobile laser scanning (MLS) systems, unmanned aerial vehicle (UAV)-based laser scanning (ULS) systems and backpack laser scanning (BLS) systems. Experimental results, and comparisons with state-of-the-art methods, demonstrate that the PGVNet model is able to effectively identify various cars, trees, traffic poles and small objects from generalized point clouds, and achieves promising performances on roadside object classifications, with an overall accuracy of 95.76%. Our code is released on https://github.com/flidarcode/PGVNet.

A semantic segmentation method for vehicle‐borne laser scanning point clouds in motorway scenes

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

PSFE-Net: Semantic Segmentation Network for Airborne LiDAR Transmission Corridor Scenes Inspection

VPC-Net: Completion of 3D Vehicles from MLS Point Clouds

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

Automatic Road Marking Extraction and Vectorization from Vehicle-Borne Laser Scanning Data

Large-scale point cloud semantic segmentation via local perception and global descriptor vector

VIN: Voxel-based Implicit Network for Joint 3D Object Detection and Segmentation for Lidars

Road Environment Semantic Segmentation with Deep Learning from MLS Point Cloud Data

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds

Hybrid CNN-LSTM Architecture for LiDAR Point Clouds Semantic Segmentation

Vehicle Instance Segmentation from Aerial Image and Video Using a Multi-Task Learning Residual Fully Convolutional Network

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

Multilevel intuitive attention neural network for airborne LiDAR point cloud semantic segmentation

LU-Net: A Simple Approach to 3D LiDAR Point Cloud Semantic Segmentation

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

Semantic Segmentation of Aerial Laser Point Clouds Based on Deep-Residual Enhanced Coding of Multi-Feature Information