Abstract:Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of several different sensors such as LiDAR, radar, ultrasound sensors and cameras are utilized to sense the surrounding environment of autonomous vehicles. These heterogeneous sensors simultaneously capture various physical attributes of the environment. Such multimodality and redundancy of sensing need to be positively utilized for reliable and consistent perception of the environment through sensor data fusion. However, these multimodal sensor data streams are different from each other in many ways, such as temporal and spatial resolution, data format, and geometric alignment. For the subsequent perception algorithms to utilize the diversity offered by multimodal sensing, the data streams need to be spatially, geometrically and temporally aligned with each other. In this paper, we address the problem of fusing the outputs of a Light Detection and Ranging (LiDAR) scanner and a wide-angle monocular image sensor for free space detection. The outputs of LiDAR scanner and the image sensor are of different spatial resolutions and need to be aligned with each other. A geometrical model is used to spatially align the two sensor outputs, followed by a Gaussian Process (GP) regression-based resolution matching algorithm to interpolate the missing data with quantifiable uncertainty. The results indicate that the proposed sensor data fusion framework significantly aids the subsequent perception steps, as illustrated by the performance improvement of a uncertainty aware free space detection algorithm.

Multi-Sensor Fusion on Automated Guided Vehicle

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Driving Assistance System Based on Data Fusion of Multisource Sensors for Autonomous Unmanned Ground Vehicles.

Radar and Camera Fusion Based Moving Obstacle Tracking for Automated Vehicles

MSFVT: A Multi-Sensor Fusion System for Vehicle Position Tracking in Unstructured Environments

Data Fusion of Roadside Camera, LiDAR and Millimeter Wave Radar

Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving

Multi-sensor Information Fusion for Unmanned Cars Using Radar Map

Multimodal Information Fusion for High-Robustness and Low-Drift State Estimation of UGVs in Diverse Scenes

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles

Multi-sensor Fusion Detection Method for Vehicle Target Based on Kalman Filter and Data Association Filter

Multi-Sensor Fusion in Automated Driving: A Survey

Study on Multi-Heterogeneous Sensor Data Fusion Method Based on Millimeter-Wave Radar and Camera

Robust Fusion of LiDAR and Wide-Angle Camera Data for Autonomous Mobile Robots

Vehicle Detection Based on Information Fusion of mmWave Radar and Monocular Vision

Object Detection and State Estimation of Autonomous Vehicles with Multi-Sensor Information Fusion

Sensor Fusion Method for Object Detection and Distance Estimation in Assisted Driving Applications

MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusion

Sensor Fusion SLAM: An Efficient and Robust SLAM system for Dynamic Environments

Robust 3D Semantic Segmentation Based on Multi-Phase Multi-Modal Fusion for Intelligent Vehicles