Abstract:Unmanned vehicles need to make a comprehensive perception of the surrounding environmental information during driving. Perception of automotive information is of significance. In the field of automotive perception, the sterevision of car-detection plays a vital role and sterevision can calculate the length, width, and height of a car, making the car more specific. However, under the existing technology, it is impossible to obtain accurate detection in a complex environment by relying on a single sensor. Therefore, it is particularly important to study the complex sensing technology based on multi-sensor fusion. Recently, with the development of deep learning in the field of vision, a mobile sensor-fusion method based on deep learning is proposed and applied in this paper--Mobile Deep Sensor Fusion Model (MDSFM). The content of this article is as follows. It does a data processing that projects 3D data to 2D data, which can form a dataset suitable for the model, thereby training data more efficiently. In the modules of LiDAR, it uses a revised squeezeNet structure to lighten the model and reduce parameters. In the modules of cameras, it uses the improved design of detecting module in R-CNN with a Mobile Spatial Attention Module (MSAM). In the fused part, it uses a dual-view deep fusing structure. And then it selects images from the KITTI's datasets for validation to test this model. Compared with other recognized methods, it shows that our model has a fairly good performance. Finally, it implements a ROS program on the experimental car and our model is in good condition. The result shows that it can improve performance of detecting easy cars significantly through MDSFM. It increases the quality of the detected data and improves the generalized ability of car-detection model. It improves contextual relevance and preserves background information. It remains stable in driverless environments. It is applied in the realistic scenario and proves that the model has a good practical value.

Multi-sensor fusion algorithm in cooperative vehicle-infrastructure system for blind spot warning

Multi-Sensor Fusion in Automated Driving: A Survey

An Efficient Multi‐sensor Fusion and Tracking Protocol in a Vehicle‐road Collaborative System

Design and Research of Multi-sensor Detection System for Internet of Vehicles

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Beyond-line-of-sight Perception Enhancement Via Information Interaction in Connected Autonomous Driving Environment

V2I-BEVF: Multi-modal Fusion Based on BEV Representation for Vehicle-Infrastructure Perception

Multi-Sensor Fusion and Cooperative Perception for Autonomous Driving: A Review

Occlusion-Guided Multi-Modal Fusion for Vehicle-Infrastructure Cooperative 3D Object Detection

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

LiDAR-Camera Fusion: Guided Vehicle-to-Aircraft Sensing with Cooperative Vehicle Infrastructure

Multimedia Fusion at Semantic Level in Vehicle Cooperactive Perception

Study of Assisted Driving System Based on Multi-Sensor Information Fusion

Enhancing 3D object detection through multi-modal fusion for cooperative perception

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

Intelligent Perception System for Vehicle-Road Cooperation

V2I-Coop: Accurate Object Detection for Connected Automated Vehicles at Accident Black Spots with V2I Cross-Modality Cooperation

Sensor Fusion Method for Object Detection and Distance Estimation in Assisted Driving Applications

Multi-sensor Fusion Detection Method for Vehicle Target Based on Kalman Filter and Data Association Filter

Location-based Cooperative Vehicle Collision Avoidance for Unsignalized Intersections: A Multi-sensor Integration Approach