Abstract:The rapid development of Autonomous Vehicles (AVs) increases the requirement for the accurate prediction of objects in the vicinity to guarantee safer journeys. For effectively predicting objects, sensors such as Three-Dimensional Light Detection and Ranging (3D LiDAR) and cameras can be used. The 3D LiDAR sensor captures the 3D shape of the object and produces point cloud data that describes the geometrical structure of the object. The LiDAR-only detectors may be subject to false detection or even non-detection over objects located at high distances. The camera sensor captures RGB images with sufficient attributes that describe the distinct identification of the object. The high-resolution images produced by the camera sensor benefit the precise classification of the objects. However, hindrances such as the absence of depth information from the images, unstructured point clouds, and cross modalities affect assertion and boil down the environmental perception. To this end, this paper proposes an object detection mechanism that fuses the data received from the camera sensor and the 3D LiDAR sensor (OD-C3DL). The 3D LiDAR sensor obtains point clouds of the object such as distance, position, and geometric shape. The OD-C3DL employs Convolutional Neural Networks (CNN) for further processing point clouds obtained from the 3D LiDAR sensor and the camera sensor to recognize the objects effectively. The point cloud of the LiDAR is enhanced and fused with the image space on the Regions of Interest (ROI) for easy recognition of the objects. The evaluation results show that the OD-C3DL can provide an average of 89 real-time objects for a frame and reduces the extraction time by a recall rate of 94%. The average processing time is 65ms, which makes the OD-C3DL model incredibly suitable for the AVs perception. Furthermore, OD-C3DL provides mean accuracy for identifying automobiles and pedestrians at a moderate degree of difficulty is higher than that of the previous models at 79.13% and 88.76%.

Design of robust deep learning-based object detection and classification model for autonomous driving applications

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

Dual Architecture Deep Learning Based Object Detection System for Autonomous Driving

Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors

Object recognition and detection with deep learning for autonomous driving applications

Real-time Traffic Object Detection for Autonomous Driving

Object Detection and Classification Framework for Analysis of Video Data Acquired from Indian Roads

ObjectDetect: A Real-Time Object Detection Framework for Advanced Driver Assistant Systems Using YOLOv5

Real-Time Object Detection in Occluded Environment with Background Cluttering Effects Using Deep Learning

Real-Time Object Detection Using Pre-Trained Deep Learning Models MobileNet-SSD

Edge YOLO: Real-Time Intelligent Object Detection System Based on Edge-Cloud Cooperation in Autonomous Vehicles

Performance Analysis of SSD and Faster RCNN Multi-class Object Detection Model for Autonomous Driving Vehicle Research Using CARLA Simulator

Deep Learning based Object Detection Model for Autonomous Driving Research using CARLA Simulator

Road Feature Detection for Advance Driver Assistance System Using Deep Learning

Exploiting Remote Sensing Imagery For Vehicle Detection And Classification Using Robust Competitive Algorithm With Deep Convolutional Neural Network

A deep reinforcement learning assisted task offloading and resource allocation approach towards self-driving object detection

Identification of Driver Phone Usage Violations via State-of-the-Art Object Detection with Tracking

Deep Learning-based Road Object Detection for Collision Avoidance in Autonomous Driving

DALDet: Depth-Aware Learning Based Object Detection for Autonomous Driving

Real-time Traffic Surveillance and Detection using Deep Learning and Computer Vision Techniques

A Deep Learning approach for fire object detection in Autonomous vehicles