Abstract:The human perception to the outside world is the results of action among brain and many organs. For example, the intelligent robots that people currently investigate can have many sensors for sense of vision, sense of hearing, sense of taste, sense of smell, sense of touch, sense of pain, sense of heat, sense of force, sense of slide, sense of approach (Luo, 2002). All these sensors provide different profile information of scene in same environment. To use suitable techniques for assorting with various sensors and combining their obtained information, the theories and methods of multi-sensor fusion are required. Multi-sensor information fusion is a basic ability of human beings. Single sensor can only provide incomplete, un-accurate, vague, uncertainty information. Sometimes, information obtained by different sensors can even be contradictory. Human beings have the ability to combine the information obtained by different organs and then make estimation and decision for environment and events. Using computer to perform multi-sensor information fusion can be considered as a simulation of the function of human brain for treating complex problems. Multi-sensor information fusion consists of operating on the information data come from various sensors and obtaining more comprehensive, accurate, and robust results than that obtained from single sensor. Fusion can be defined as the process of combined treating of data acquired from multiple sensors, as well as assorting, optimizing and conforming of these data to increase the ability of extracting information and improving the decision capability. Fusion can extend the coverage for space and time information, reducing the fuzziness, increasing the reliability of making decision, and the robustness of systems. Image fusion is a particular type of multi-sensor fusion, which takes images as operating objects. In a more general sense of image engineering (Zhang, 2006), the combination of multi-resolution images also can be counted as a fusion process. In this article, however, the emphasis is put on the information fusion of multi-sensor images.

Bioinspired In-Sensor Multimodal Fusion for Enhanced Spatial and Spatiotemporal Association

A Multimodal Sensing CMOS Imager Based on Dual‐Focus Imaging(Adv. Sci. 14/2023)

CMCI: A Robust Multimodal Fusion Method for Spiking Neural Networks

Multimodal Sensors and ML‐Based Data Fusion for Advanced Robots

Investigating Multisensory Integration in Emotion Recognition Through Bio-Inspired Computational Models

Event-Based Multimodal Spiking Neural Network with Attention Mechanism

Visual-Olfactory Synergistic Perception Based on Dual-Focus Imaging and a Bionic Learning Architecture

Deep Multimodal Data Fusion

Bioinspired multisensory neural network with crossmodal integration and recognition

Multi-modal bioelectrical signal fusion analysis based on different acquisition devices and scene settings: Overview, challenges, and novel orientation

Multi-modal Sensor Fusion for Auto Driving Perception: A Survey

Weakly Paired Multimodal Fusion for Object Recognition.

Multi-Sensor Image Fusion Using Optimized Support Vector Machine and Multiscale Weighted Principal Component Analysis

Information Fusion of Multi-Sensor Images

A Crayfish-Inspired Sensor Fusion Platform for Super Additive Integration of Visual, Chemical, and Tactile Information

Deep Fusion Of Heterogeneous Sensor Data

A General Spatial-Frequency Learning Framework for Multimodal Image Fusion

OVERVIEW OF MULTISENSOR INTEGRATION AND FUSION

Robust Multi-Modal Sensor Fusion: An Adversarial Approach

Multimodal Fusion for Robotics

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention