Abstract:Recent technological advancements in computer vision algorithms and data acquisition devices have greatly facilitated the research and applications of deep learning-based traffic object recognition from Light Detection and Ranging (LiDAR) data. The majority of existing methodologies applied deep learning (DL)-based techniques, especially Convolutional Neural Networks (CNNs), for vehicle detection and tracking on autonomous driving datasets. Nevertheless, fewer studies were focused on DL-based vehicle detection using roadside LiDAR data, partially due to the lack of publicly available roadside LiDAR datasets for network training and testing. This paper develops a novel framework based on CNNs and LiDAR data for automated vehicle detection. It leverages the domain knowledge of CNNs trained on large-scale autonomous driving datasets for vehicle detection from roadside LiDAR data. In the experimental study, roadside LiDAR data were collected at a road intersection in Reno, Nevada, U.S. Meanwhile, a CNN architecture was proposed to detect vehicles from LiDAR data through 3D bounding boxes. The proposed CNN was modified from the established PointPillars network by adding dense connections to the convolutional layers to achieve more comprehensive feature extraction. Three CNNs, including the proposed CNN, PointPillars, and YOLOv4, were trained and tested on PandaSet, a publicly available large-scale autonomous driving LiDAR dataset. Subsequently, the trained CNNs were reused for vehicle detection from the captured roadside LiDAR data. The experimental results demonstrated that the proposed CNN outperformed the others in the testing metrics. All three networks showed good performance on vehicle detection from the captured roadside LiDAR data.

Overview of Deep Learning Intelligent Driving Methods

Autonomous Driving with Human Guided Image Feature Extraction

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Vehicle-Related Scene Understanding Using Deep Learning

Research on the Application of Computer Vision Based on Deep Learning in Autonomous Driving Technology

Survey of the Image Recognition Based on Deep Learning Network for Autonomous Driving Car

Moving vehicle tracking and scene understanding: A hybrid approach

Deep learning and control algorithms of direct perception for autonomous driving

Deep learning-based perception systems for autonomous driving: A comprehensive survey

Blind Spot Monitoring Using Deep Learning.

Driving Assistance System Based on Deep Learning and Traditional Vision

Deep learning in autonomous driving: Advantages, limitations, and innovative solutions

A Survey on Theories and Applications for Self-Driving Cars Based on Deep Learning Methods

Advancing Autonomous Navigation: Deep Learning Techniques for Self-Driving Cars

Deep Learning for Autonomous Driving System

An Empirical Evaluation of Deep Learning on Highway Driving

Leveraging Deep Convolutional Neural Networks Pre-Trained on Autonomous Driving Data for Vehicle Detection From Roadside LiDAR Data

A survey to applications of deep learning in autonomous driving

Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies

Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding