Real-time Traffic Object Detection for Autonomous Driving

Abdul Hannan Khan,Syed Tahseen Raza Rizvi,Andreas Dengel

2024-03-01

Abstract:With recent advances in computer vision, it appears that autonomous driving will be part of modern society sooner rather than later. However, there are still a significant number of concerns to address. Although modern computer vision techniques demonstrate superior performance, they tend to prioritize accuracy over efficiency, which is a crucial aspect of real-time applications. Large object detection models typically require higher computational power, which is achieved by using more sophisticated onboard hardware. For autonomous driving, these requirements translate to increased fuel costs and, ultimately, a reduction in mileage. Further, despite their computational demands, the existing object detectors are far from being real-time. In this research, we assess the robustness of our previously proposed, highly efficient pedestrian detector LSFM on well-established autonomous driving benchmarks, including diverse weather conditions and nighttime scenes. Moreover, we extend our LSFM model for general object detection to achieve real-time object detection in traffic scenes. We evaluate its performance, low latency, and generalizability on traffic object detection datasets. Furthermore, we discuss the inadequacy of the current key performance indicator employed by object detection systems in the context of autonomous driving and propose a more suitable alternative that incorporates real-time requirements.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the balance between the efficiency and performance of real - time traffic object detection in current autonomous driving systems. Although modern computer vision techniques perform well in terms of accuracy, they often prioritize accuracy over efficiency, which is a crucial issue for applications that require real - time processing. Large object detection models usually require higher computing power, which leads to an increase in fuel costs and a decrease in driving range for autonomous vehicles. Moreover, existing object detectors, despite their high computational requirements, are still far from meeting the requirements for real - time processing (e.g., 30 frames per second). Therefore, this paper aims to evaluate the robustness of the previously proposed efficient pedestrian detector LSFM in well - known autonomous driving benchmarks, especially under different weather conditions and night - time scenarios, and extend it to general traffic object detection in order to achieve real - time object detection in traffic scenes. At the same time, this paper also discusses the shortcomings of the performance metrics used in current object detection systems in the context of autonomous driving and proposes a new performance metric that is more suitable for real - time requirements.

Real-time Traffic Object Detection for Autonomous Driving

ObjectDetect: A Real-Time Object Detection Framework for Advanced Driver Assistant Systems Using YOLOv5

Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Smart traffic control: machine learning for dynamic road traffic management in urban environments

A survey on 3D object detection in real time for autonomous driving

Road Feature Detection for Advance Driver Assistance System Using Deep Learning

Deep CNN-Based Real-Time Traffic Light Detector for Self-Driving Vehicles

Real-Time Detection and Analysis of Vehicles and Pedestrians using Deep Learning

Design of robust deep learning-based object detection and classification model for autonomous driving applications

A Fast and Accurate Real-Time Vehicle Detection Method Using Deep Learning for Unconstrained Environments

Efficientdet Based Visial Perception for Autonomous Driving

Generalized Haar Filter based Deep Networks for Real-Time Object Detection in Traffic Scene

Vehicle Detection Under Traffic Scenarios Based on Faster RCNN and YOLO

Real-time Traffic Surveillance and Detection using Deep Learning and Computer Vision Techniques

Performance Analysis of SSD and Faster RCNN Multi-class Object Detection Model for Autonomous Driving Vehicle Research Using CARLA Simulator

A Real-Time Object Detector for Autonomous Vehicles Based on YOLOv4

Lightweight Real-Time Object Detection via Enhanced Global Perception and Intra-Layer Interaction for Complex Traffic Scenarios

Real-Time Vehicle Object Detection Method Based on Multi-Scale Feature Fusion

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

FuseMODNet: Real-Time Camera and LiDAR based Moving Object Detection for robust low-light Autonomous Driving