Abstract:Urban management and survey departments have begun investigating the feasibility ofacquiring data from various laser scanning systems for urban infrastructure measurements and assessments. Roadside objects such as cars, trees, traffic poles, pedestrians, bicycles and e-bicycles describe the static and dynamic urban information available for acquisition. Because of the unstructured nature of 3D point clouds, the rich targets in complex road scenes, and the varying scales of roadside objects, finely classifying these roadside objects from various point clouds is a challenging task. In this paper, we integrate two representations of roadside objects, point clouds and multiview images to propose a point-group-view network named PGVNet for classifying roadside objects into cars, trees, traffic poles, and small objects (pedestrians, bicycles and e-bicycles) from generalized point clouds. To utilize the topological information of the point clouds, we propose a graph attention convolution operation called AtEdgeConv to mine the relationship among the local points and to extract local geometric features. In addition, we employ a hierarchical view-group-object architecture to diminish the redundant information between similar views and to obtain salient viewwise global features. To fuse the local geometric features from the point clouds and the global features from multiview images, we stack an attention-guided fusion network in PGVNet. In particular, we quantify and leverage the global features as an attention mask to capture the intrinsic correlation and discriminability of the local geometric features, which contributes to recognizing the different roadside objects with similar shapes. To verify the effectiveness and generalization of our methods, we conduct extensive experiments on six test datasets of different urban scenes, which were captured by different laser scanning systems, including mobile laser scanning (MLS) systems, unmanned aerial vehicle (UAV)-based laser scanning (ULS) systems and backpack laser scanning (BLS) systems. Experimental results, and comparisons with state-of-the-art methods, demonstrate that the PGVNet model is able to effectively identify various cars, trees, traffic poles and small objects from generalized point clouds, and achieves promising performances on roadside object classifications, with an overall accuracy of 95.76%. Our code is released on https://github.com/flidarcode/PGVNet.

LiDAR Vehicle Point Cloud Reconstruction Framework for Axle-based Classification

Truck body type classification using a deep representation learning ensemble on 3D point sets

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Robust LiDAR-Based Vehicle Detection for On-Road Autonomous Driving

A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds

Accurate detection of vehicle, pedestrian, cyclist and wheelchair from roadside light detection and ranging sensors

3D Object Detection and High-Resolution Traffic Parameters Extraction Using Low-Resolution LiDAR Data

Leveraging Deep Convolutional Neural Networks Pre-Trained on Autonomous Driving Data for Vehicle Detection From Roadside LiDAR Data

Classification of Typical Static Objects in Road Scenes Based on LO-Net

A Comprehensive Framework for Transportation Infrastructure Digitalization: TJYRoad-Net for Enhanced Point Cloud Segmentation

Leveraging PointNet and PointNet++ for Lyft Point Cloud Classification Challenge

Integrating Normal Vector Features into an Atrous Convolution Residual Network for LiDAR Point Cloud Classification

Capsule-Based Networks for Road Marking Extraction and Classification From Mobile LiDAR Point Clouds

2D&3DHNet for 3D Object Classification in LiDAR Point Cloud

Roadside LiDAR Vehicle Detection and Tracking Using Range and Intensity Background Subtraction

Classifying airborne LiDAR point clouds via deep features learned by a multi-scale convolutional neural network

Convolution Neural Network Application for Road Asset Detection and Classification in LiDAR Point Cloud

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

Automatic Pylon Extraction Using Color-Aided Classification From UAV LiDAR Point Cloud Data

HPCR-VI: Heterogeneous Point Cloud Registration for Vehicle-Infrastructure Collaboration.