Abstract:Unmanned vehicles need to make a comprehensive perception of the surrounding environmental information during driving. Perception of automotive information is of significance. In the field of automotive perception, the sterevision of car-detection plays a vital role and sterevision can calculate the length, width, and height of a car, making the car more specific. However, under the existing technology, it is impossible to obtain accurate detection in a complex environment by relying on a single sensor. Therefore, it is particularly important to study the complex sensing technology based on multi-sensor fusion. Recently, with the development of deep learning in the field of vision, a mobile sensor-fusion method based on deep learning is proposed and applied in this paper--Mobile Deep Sensor Fusion Model (MDSFM). The content of this article is as follows. It does a data processing that projects 3D data to 2D data, which can form a dataset suitable for the model, thereby training data more efficiently. In the modules of LiDAR, it uses a revised squeezeNet structure to lighten the model and reduce parameters. In the modules of cameras, it uses the improved design of detecting module in R-CNN with a Mobile Spatial Attention Module (MSAM). In the fused part, it uses a dual-view deep fusing structure. And then it selects images from the KITTI's datasets for validation to test this model. Compared with other recognized methods, it shows that our model has a fairly good performance. Finally, it implements a ROS program on the experimental car and our model is in good condition. The result shows that it can improve performance of detecting easy cars significantly through MDSFM. It increases the quality of the detected data and improves the generalized ability of car-detection model. It improves contextual relevance and preserves background information. It remains stable in driverless environments. It is applied in the realistic scenario and proves that the model has a good practical value.

Vehicle Object Detection Based on RGB-Camera and Radar Sensor Fusion

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

An End-to-End Deep Learning Network for 3D Object Detection From RGB-D Data Based on Hough Voting

Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving.

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Radar-Camera Sensor Fusion for Joint Object Detection and Distance Estimation in Autonomous Vehicles

Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving

3D Object Detection for Point Cloud in Virtual Driving Environment

Multi-view 3D Object Detection Network for Autonomous Driving

Object Detection Using Multi-Sensor Fusion Based on Deep Learning

RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization

Stereo RGB and Deeper LIDAR Based Network for 3D Object Detection

3D Object Detector: A Multiscale Region Proposal Network Based on Autonomous Driving.

Multiattention Mechanism 3D Object Detection Algorithm Based on RGB and LiDAR Fusion for Intelligent Driving

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

Multi-Task Foreground-Aware Network with Depth Completion for Enhanced RGB-D Fusion Object Detection Based on Transformer

Channelwise and Spatially Guided Multimodal Feature Fusion Network for 3-D Object Detection in Autonomous Vehicles

Deep LiDAR-Radar-Visual Fusion for Object Detection in Urban Environments

CrossFusion net: Deep 3D object detection based on RGB images and point clouds in autonomous driving