Abstract:Urban management and survey departments have begun investigating the feasibility ofacquiring data from various laser scanning systems for urban infrastructure measurements and assessments. Roadside objects such as cars, trees, traffic poles, pedestrians, bicycles and e-bicycles describe the static and dynamic urban information available for acquisition. Because of the unstructured nature of 3D point clouds, the rich targets in complex road scenes, and the varying scales of roadside objects, finely classifying these roadside objects from various point clouds is a challenging task. In this paper, we integrate two representations of roadside objects, point clouds and multiview images to propose a point-group-view network named PGVNet for classifying roadside objects into cars, trees, traffic poles, and small objects (pedestrians, bicycles and e-bicycles) from generalized point clouds. To utilize the topological information of the point clouds, we propose a graph attention convolution operation called AtEdgeConv to mine the relationship among the local points and to extract local geometric features. In addition, we employ a hierarchical view-group-object architecture to diminish the redundant information between similar views and to obtain salient viewwise global features. To fuse the local geometric features from the point clouds and the global features from multiview images, we stack an attention-guided fusion network in PGVNet. In particular, we quantify and leverage the global features as an attention mask to capture the intrinsic correlation and discriminability of the local geometric features, which contributes to recognizing the different roadside objects with similar shapes. To verify the effectiveness and generalization of our methods, we conduct extensive experiments on six test datasets of different urban scenes, which were captured by different laser scanning systems, including mobile laser scanning (MLS) systems, unmanned aerial vehicle (UAV)-based laser scanning (ULS) systems and backpack laser scanning (BLS) systems. Experimental results, and comparisons with state-of-the-art methods, demonstrate that the PGVNet model is able to effectively identify various cars, trees, traffic poles and small objects from generalized point clouds, and achieves promising performances on roadside object classifications, with an overall accuracy of 95.76%. Our code is released on https://github.com/flidarcode/PGVNet.

Convolution Neural Network Application for Road Asset Detection and Classification in LiDAR Point Cloud

LMNet: Real-time Multiclass Object Detection on CPU using 3D LiDAR

On-road multiple obstacles detection using color images and LiDAR point clouds

Leveraging Deep Convolutional Neural Networks Pre-Trained on Autonomous Driving Data for Vehicle Detection From Roadside LiDAR Data

Flexible Neural Network for Fast and Accurate Road Scene Perception.

Classification of Typical Static Objects in Road Scenes Based on LO-Net

A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds

A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds

D-Net: A Density-Based Convolutional Neural Network for Mobile LiDAR Point Clouds Classification in Urban Areas

A Nonlinear Convolutional Neural Network Algorithm for Autonomous Vehicle Lane Line Detection

A Novel CNN Architecture for Real-Time Point Cloud Recognition in Road Environment

Deconvolutional Networks for Point-Cloud Vehicle Detection and Tracking in Driving Scenarios

Low-Power Drone-Mountable Real-Time Artificial Intelligence Framework for Road Asset Classification

VS-Net: A Voxel Encoding and Sparse Convolution Embedded Network for LiDAR 3D Object Detection.

DepthCN: Vehicle detection using 3D-LIDAR and ConvNet

Lightweight convolutional neural network for real-time 3D object detection in road and railway environments

Fusion of neural networks, for LIDAR-based evidential road mapping

Real-Time Road Curb and Lane Detection for Autonomous Driving Using LiDAR Point Clouds

Detecting Danger: AI-Enabled Road Crack Detection for Autonomous Vehicles

Real-Time And Robust 3D Object Detection with Roadside LiDARs

A Novel Convolutional Neural Network Based Architecture for Object Detection and Recognition with an Application to Traffic Sign Recognition from Road Scenes