Abstract:Recent technological advancements in computer vision algorithms and data acquisition devices have greatly facilitated the research and applications of deep learning-based traffic object recognition from Light Detection and Ranging (LiDAR) data. The majority of existing methodologies applied deep learning (DL)-based techniques, especially Convolutional Neural Networks (CNNs), for vehicle detection and tracking on autonomous driving datasets. Nevertheless, fewer studies were focused on DL-based vehicle detection using roadside LiDAR data, partially due to the lack of publicly available roadside LiDAR datasets for network training and testing. This paper develops a novel framework based on CNNs and LiDAR data for automated vehicle detection. It leverages the domain knowledge of CNNs trained on large-scale autonomous driving datasets for vehicle detection from roadside LiDAR data. In the experimental study, roadside LiDAR data were collected at a road intersection in Reno, Nevada, U.S. Meanwhile, a CNN architecture was proposed to detect vehicles from LiDAR data through 3D bounding boxes. The proposed CNN was modified from the established PointPillars network by adding dense connections to the convolutional layers to achieve more comprehensive feature extraction. Three CNNs, including the proposed CNN, PointPillars, and YOLOv4, were trained and tested on PandaSet, a publicly available large-scale autonomous driving LiDAR dataset. Subsequently, the trained CNNs were reused for vehicle detection from the captured roadside LiDAR data. The experimental results demonstrated that the proposed CNN outperformed the others in the testing metrics. All three networks showed good performance on vehicle detection from the captured roadside LiDAR data.

DepthCN: Vehicle detection using 3D-LIDAR and ConvNet

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Robust vehicle detection using 3D Lidar under complex urban environment

Real-Time Deep ConvNet-Based Vehicle Detection Using 3D-LIDAR Reflection Intensity Data

Deconvolutional Networks for Point-Cloud Vehicle Detection and Tracking in Driving Scenarios

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

3D Fully Convolutional Network for Vehicle Detection in Point Cloud

Leveraging Deep Convolutional Neural Networks Pre-Trained on Autonomous Driving Data for Vehicle Detection From Roadside LiDAR Data

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

3D Detection for Occluded Vehicles From Point Clouds

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

DALDet: Depth-Aware Learning Based Object Detection for Autonomous Driving

Image Guidance Based 3D Vehicle Detection in Traffic Scene.

Virtual Sparse Convolution for Multimodal 3D Object Detection

3D Object Detection for Point Cloud in Virtual Driving Environment

PA3DNet: 3-D Vehicle Detection with Pseudo Shape Segmentation and Adaptive Camera-LiDAR Fusion

Monocular 3-D Vehicle Detection Using a Cascade Network for Autonomous Driving

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Convolution Neural Network Application for Road Asset Detection and Classification in LiDAR Point Cloud