Abstract:The rapid development of Autonomous Vehicles (AVs) increases the requirement for the accurate prediction of objects in the vicinity to guarantee safer journeys. For effectively predicting objects, sensors such as Three-Dimensional Light Detection and Ranging (3D LiDAR) and cameras can be used. The 3D LiDAR sensor captures the 3D shape of the object and produces point cloud data that describes the geometrical structure of the object. The LiDAR-only detectors may be subject to false detection or even non-detection over objects located at high distances. The camera sensor captures RGB images with sufficient attributes that describe the distinct identification of the object. The high-resolution images produced by the camera sensor benefit the precise classification of the objects. However, hindrances such as the absence of depth information from the images, unstructured point clouds, and cross modalities affect assertion and boil down the environmental perception. To this end, this paper proposes an object detection mechanism that fuses the data received from the camera sensor and the 3D LiDAR sensor (OD-C3DL). The 3D LiDAR sensor obtains point clouds of the object such as distance, position, and geometric shape. The OD-C3DL employs Convolutional Neural Networks (CNN) for further processing point clouds obtained from the 3D LiDAR sensor and the camera sensor to recognize the objects effectively. The point cloud of the LiDAR is enhanced and fused with the image space on the Regions of Interest (ROI) for easy recognition of the objects. The evaluation results show that the OD-C3DL can provide an average of 89 real-time objects for a frame and reduces the extraction time by a recall rate of 94%. The average processing time is 65ms, which makes the OD-C3DL model incredibly suitable for the AVs perception. Furthermore, OD-C3DL provides mean accuracy for identifying automobiles and pedestrians at a moderate degree of difficulty is higher than that of the previous models at 79.13% and 88.76%.

LiDAR-based Object Detection Failure Tolerated Autonomous Driving Planning System.

Robust LiDAR-Based Vehicle Detection for On-Road Autonomous Driving

When, Where and How Does It Fail? A Spatial-Temporal Visual Analytics Approach for Interpretable Object Detection in Autonomous Driving.

Long-Tail Prediction Uncertainty Aware Trajectory Planning for Self-driving Vehicles.

Real-Time Joint Simulation of LiDAR Perception and Motion Planning for Automated Driving

Obstacle Detection for Autonomous Driving Vehicles With Multi-LiDAR Sensor Fusion

On-road multiple obstacles detection using color images and LiDAR point clouds

An Efficient Real-Time Object Detection and Tracking Framework Based on Lidar and Ins

A Vision-Based Method for Improving the Safety of Self-Driving

Path Planning based on 2D Object Bounding-box

Visual Road Boundary Detection based Local Path Planner.

Towards Unsupervised Object Detection From LiDAR Point Clouds

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

3D Object Detection for Point Cloud in Virtual Driving Environment

Adaptive Road Detection Method Combining Lane Line and Obstacle Boundary

Machine vision-based autonomous road hazard avoidance system for self-driving vehicles

Perception, Planning and Control for Self-Driving System Based on On-board Sensors

An Autonomous Driving Approach Based on Trajectory Learning Using Deep Neural Networks

Dual-view 3D Object Recognition and Detection Via Lidar Point Cloud and Camera Image

Fusion Strategy of Multi-sensor Based Object Detection for Self-driving Vehicles.

Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors