Abstract:Unmanned vehicles need to make a comprehensive perception of the surrounding environmental information during driving. Perception of automotive information is of significance. In the field of automotive perception, the sterevision of car-detection plays a vital role and sterevision can calculate the length, width, and height of a car, making the car more specific. However, under the existing technology, it is impossible to obtain accurate detection in a complex environment by relying on a single sensor. Therefore, it is particularly important to study the complex sensing technology based on multi-sensor fusion. Recently, with the development of deep learning in the field of vision, a mobile sensor-fusion method based on deep learning is proposed and applied in this paper--Mobile Deep Sensor Fusion Model (MDSFM). The content of this article is as follows. It does a data processing that projects 3D data to 2D data, which can form a dataset suitable for the model, thereby training data more efficiently. In the modules of LiDAR, it uses a revised squeezeNet structure to lighten the model and reduce parameters. In the modules of cameras, it uses the improved design of detecting module in R-CNN with a Mobile Spatial Attention Module (MSAM). In the fused part, it uses a dual-view deep fusing structure. And then it selects images from the KITTI's datasets for validation to test this model. Compared with other recognized methods, it shows that our model has a fairly good performance. Finally, it implements a ROS program on the experimental car and our model is in good condition. The result shows that it can improve performance of detecting easy cars significantly through MDSFM. It increases the quality of the detected data and improves the generalized ability of car-detection model. It improves contextual relevance and preserves background information. It remains stable in driverless environments. It is applied in the realistic scenario and proves that the model has a good practical value.

Environment Recognition from A Spherical Camera Image Based on DeepLab V3+

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

DeepCamera

Semantic Visual Odometry Based on Panoramic Annular Imaging

Wheelchair Behavior Recognition for Visualizing Sidewalk Accessibility by Deep Neural Networks

Road Environment Perception for Unmanned Motion Platform Based on Binocular Vision

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map

Dual-view 3D Object Recognition and Detection Via Lidar Point Cloud and Camera Image

A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye View

Deep Spherical Panoramic Representation for 3D Shape Recognition

A 3D Object Recognition Method From LiDAR Point Cloud Based on USAE-BLS

Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People

Environmental Detection for Autonomous Vehicles Based on Multi-View Image and 3D LiDAR Point Cloud Map

Self-Supervised Sidewalk Perception Using Fast Video Semantic Segmentation for Robotic Wheelchairs in Smart Mobility

Evaluation of 2D-/3D-Feet-Detection Methods for Semi-Autonomous Powered Wheelchair Navigation

Vision-Based Environmental Perception for Autonomous Driving

Semantic Mapping for Smart Wheelchairs Using RGB-D Camera

3D car-detection based on a Mobile Deep Sensor Fusion Model and real-scene applications

Outdoor 3D Environment Reconstruction based on Multi-sensor Fusion for Remote Control