Abstract:Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of several different sensors such as LiDAR, radar, ultrasound sensors and cameras are utilized to sense the surrounding environment of autonomous vehicles. These heterogeneous sensors simultaneously capture various physical attributes of the environment. Such multimodality and redundancy of sensing need to be positively utilized for reliable and consistent perception of the environment through sensor data fusion. However, these multimodal sensor data streams are different from each other in many ways, such as temporal and spatial resolution, data format, and geometric alignment. For the subsequent perception algorithms to utilize the diversity offered by multimodal sensing, the data streams need to be spatially, geometrically and temporally aligned with each other. In this paper, we address the problem of fusing the outputs of a Light Detection and Ranging (LiDAR) scanner and a wide-angle monocular image sensor for free space detection. The outputs of LiDAR scanner and the image sensor are of different spatial resolutions and need to be aligned with each other. A geometrical model is used to spatially align the two sensor outputs, followed by a Gaussian Process (GP) regression-based resolution matching algorithm to interpolate the missing data with quantifiable uncertainty. The results indicate that the proposed sensor data fusion framework significantly aids the subsequent perception steps, as illustrated by the performance improvement of a uncertainty aware free space detection algorithm.

Research on Surface Environment Perception Via Camera-LiDAR Sensor Fusion

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

A Novel Unmanned Surface Vehicle with 2D-3D Fused Perception and Obstacle Avoidance Module

Research on Unmanned Surface Vehicles Environment Perception Based on the Fusion of Vision and Lidar

Research on Fusion Method of Lidar and Visual Image Based on Surface Vehicle

Intelligent Edge-Enabled Efficient Multi-Source Data Fusion for Autonomous Surface Vehicles in Maritime Internet of Things

Real-Time Volumetric Perception for Unmanned Surface Vehicles Through Fusion of Radar and Camera

Multi-modal Information Fusion for LiDAR-based 3D Object Detection Framework

Reliable LiDAR-based ship detection and tracking for Autonomous Surface Vehicles in busy maritime environments

Research on Active Intelligent Perception Technology of Vessel Situation Based on Multisensor Fusion

Multimodal Perception Integrating Point Cloud and Light Field for Ship Autonomous Driving

Visual Temporal Fusion Based Free Space Segmentation for Autonomous Surface Vessels

Object Detection And Tracking Of Unmanned Surface Vehicles Based On Spatial-Temporal Information Fusion

Robust Fusion of LiDAR and Wide-Angle Camera Data for Autonomous Mobile Robots

3-D Objects Detection and Tracking Using Solid-State LiDAR and RGB Camera

LCDL: Towards Dynamic Localization for Autonomous Landing of Unmanned Aerial Vehicle Based on LiDAR-Camera Fusion

Intelligent Maritime Surveillance Framework Driven by Fusion of Camera-Based Vessel Detection and AIS Data

A New Approach of Obstacle Fusion Detection for Unmanned Surface Vehicle Using Dempster-Shafer Evidence Theory

Environmental Detection for Autonomous Vehicles Based on Multi-View Image and 3D LiDAR Point Cloud Map

WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfaces

A New Multi-Sensor Fusion Approach for Integrated Ship Motion Perception in Inland Waterways