Abstract:Unmanned vehicles need to make a comprehensive perception of the surrounding environmental information during driving. Perception of automotive information is of significance. In the field of automotive perception, the sterevision of car-detection plays a vital role and sterevision can calculate the length, width, and height of a car, making the car more specific. However, under the existing technology, it is impossible to obtain accurate detection in a complex environment by relying on a single sensor. Therefore, it is particularly important to study the complex sensing technology based on multi-sensor fusion. Recently, with the development of deep learning in the field of vision, a mobile sensor-fusion method based on deep learning is proposed and applied in this paper--Mobile Deep Sensor Fusion Model (MDSFM). The content of this article is as follows. It does a data processing that projects 3D data to 2D data, which can form a dataset suitable for the model, thereby training data more efficiently. In the modules of LiDAR, it uses a revised squeezeNet structure to lighten the model and reduce parameters. In the modules of cameras, it uses the improved design of detecting module in R-CNN with a Mobile Spatial Attention Module (MSAM). In the fused part, it uses a dual-view deep fusing structure. And then it selects images from the KITTI's datasets for validation to test this model. Compared with other recognized methods, it shows that our model has a fairly good performance. Finally, it implements a ROS program on the experimental car and our model is in good condition. The result shows that it can improve performance of detecting easy cars significantly through MDSFM. It increases the quality of the detected data and improves the generalized ability of car-detection model. It improves contextual relevance and preserves background information. It remains stable in driverless environments. It is applied in the realistic scenario and proves that the model has a good practical value.

Optimal Configuration Method of Multi-source Sensors for Autonomous Vehicles Considering Three-dimensional Perception

3-D Surround View for Advanced Driver Assistance Systems.

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

An Optimal LiDAR Configuration Approach for Self-Driving Cars

Where Should We Place LiDARs on the Autonomous Vehicle? - An Optimal Design Approach

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

Adaptive Optimization Strategy and Evaluation of Vehicle-Road Collaborative Perception Algorithm in Real-Time Settings

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Optimizing the Placement of Roadside LiDARs for Autonomous Driving

Collaborative processing and data optimization of environmental perception technologies for autonomous vehicles

Toward Intelligent Sensing: Optimizing Lidar Beam Distribution for Autonomous Driving

A Detachable and Expansible Multisensor Data Fusion Model for Perception in Level 3 Autonomous Driving System

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

Improved Multi-Sensor Fusion Positioning System Based on GNSS/LiDAR/Vision/IMU With Semi-Tight Coupling and Graph Optimization in GNSS Challenging Environments

Is Your LiDAR Placement Optimized for 3D Scene Understanding?

Roadside LiDAR Sensor Configuration Assessment and Optimization Methods for Vehicle Detection and Tracking in Connected and Automated Vehicle Applications

Efficient Extrinsic Calibration of Multi-Sensor 3D LiDAR Systems for Autonomous Vehicles using Static Objects Information

Optimal Multi-Sensor Multi-Vehicle (MSMV) Localization and Mobility Tracking.

UniDrive: Towards Universal Driving Perception Across Camera Configurations

Panorama Parking Assistant System with Improved Particle Swarm Optimization Method

Automated Extrinsic Calibration of Multi-cameras and LiDAR