Abstract:Unmanned vehicles need to make a comprehensive perception of the surrounding environmental information during driving. Perception of automotive information is of significance. In the field of automotive perception, the sterevision of car-detection plays a vital role and sterevision can calculate the length, width, and height of a car, making the car more specific. However, under the existing technology, it is impossible to obtain accurate detection in a complex environment by relying on a single sensor. Therefore, it is particularly important to study the complex sensing technology based on multi-sensor fusion. Recently, with the development of deep learning in the field of vision, a mobile sensor-fusion method based on deep learning is proposed and applied in this paper--Mobile Deep Sensor Fusion Model (MDSFM). The content of this article is as follows. It does a data processing that projects 3D data to 2D data, which can form a dataset suitable for the model, thereby training data more efficiently. In the modules of LiDAR, it uses a revised squeezeNet structure to lighten the model and reduce parameters. In the modules of cameras, it uses the improved design of detecting module in R-CNN with a Mobile Spatial Attention Module (MSAM). In the fused part, it uses a dual-view deep fusing structure. And then it selects images from the KITTI's datasets for validation to test this model. Compared with other recognized methods, it shows that our model has a fairly good performance. Finally, it implements a ROS program on the experimental car and our model is in good condition. The result shows that it can improve performance of detecting easy cars significantly through MDSFM. It increases the quality of the detected data and improves the generalized ability of car-detection model. It improves contextual relevance and preserves background information. It remains stable in driverless environments. It is applied in the realistic scenario and proves that the model has a good practical value.

Vehicle Segmentation with Coarse Distance Estimation Based on Monocular Vision

Vision‐based Inter‐vehicle Distance Estimation for Driver Alarm System

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Vehicle Distance Detection Based on Monocular Vision

Robust Inter-Vehicle Distance Estimation Method Based on Monocular Vision.

Monocular Vision-based Vehicle Localization Aided by Fine-grained Classification.

Inter-Vehicle Distance Estimation Method Based on Monocular Vision Using 3D Detection

Measuring the Absolute Distance of a Front Vehicle from an In-Car Camera Based on Monocular Vision and Instance Segmentation.

Side Collision Detection Model for Visually Impaired Using Monocular Object-specific Distance Estimation and Multimodal Real-World Location Calculation

Vehicle-Related Distance Estimation Using Customized YOLOv7.

Real-time Vehicle Detection and Distance Measurement in Multi-Environment

Vehicle Motion Segmentation Via Combining Neural Networks and Geometric Methods

Vision-based Road Segmentation for Intelligent Vehicles using Deep Convolutional Neural Networks

Automatic Outer Contour Detection and Quantification of Vehicles Using Monocular Vision

Research on Vehicle Anti-collision Technique Based on Monocular Vision

An Efficient Vehicle Localization Method by Using Monocular Vision

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

Vision-Based Distance Measurement in Advanced Driving Assistance Systems

Research on Target Distance Detection Technology of Vehicle Assisted driving Based on monocular Vision

Efficient Automatic Driving Instance Segmentation Method Based on Detection

OE-BevSeg: An Object Informed and Environment Aware Multimodal Framework for Bird's-eye-view Vehicle Semantic Segmentation