Abstract:The brain integrates information from different sensory modalities to generate a coherent and accurate percept of external events. Several experimental studies suggest that this integration follows the principle of Bayesian estimate. However, the neural mechanisms responsible for this behavior, and its development in a multisensory environment, are still insufficiently understood. We recently presented a neural network model of audio-visual integration (Neural Computation, 2017) to investigate how a Bayesian estimator can spontaneously develop from the statistics of external stimuli. Model assumes the presence of two unimodal areas (auditory and visual) topologically organized. Neurons in each area receive an input from the external environment, computed as the inner product of the sensory-specific stimulus and the receptive field synapses, and a cross-modal input from neurons of the other modality. Based on sensory experience, synapses were trained via Hebbian potentiation and a decay term. Aim of this work is to improve the previous model, including a more realistic distribution of visual stimuli: visual stimuli have a higher spatial accuracy at the central azimuthal coordinate and a lower accuracy at the periphery. Moreover, their prior probability is higher at the center, and decreases toward the periphery. Simulations show that, after training, the receptive fields of visual and auditory neurons shrink to reproduce the accuracy of the input (both at the center and at the periphery in the visual case), thus realizing the likelihood estimate of unimodal spatial position. Moreover, the preferred positions of visual neurons contract toward the center, thus encoding the prior probability of the visual input. Finally, a prior probability of the co-occurrence of audio-visual stimuli is encoded in the cross-modal synapses. The model is able to simulate the main properties of a Bayesian estimator and to reproduce behavioral data in all conditions examined. In particular, in unisensory conditions the visual estimates exhibit a bias toward the fovea, which increases with the level of noise. In cross modal conditions, the SD of the estimates decreases when using congruent audio-visual stimuli, and a ventriloquism effect becomes evident in case of spatially disparate stimuli. Moreover, the ventriloquism decreases with the eccentricity.

Bayesian Inference in Model-Based Machine Vision

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

A Bayesian computer vision system for modeling human interactions

Learning Inference Models for Computer Vision

Utility-Based Control for Computer Vision

An Integrated Model for Bayesian Learning of Sparse Representation and Classifier Training.

Development of a Bayesian Estimator for Audio-Visual Integration: A Neurocomputational Study

The structure of Bayes nets for vision recognition

Nonlinear Variational Bayesian Factor Regression for Inferential Sensor Modeling

Vision as Bayesian inference: analysis by synthesis?

A Variational Bayesian Inference with Small Dataset for High-Precision Infrared Thermal Imaging.

Model Uncertainty Quantification for Reliable Deep Vision Structural Health Monitoring

Bayesian inference in physics

Bayes in the age of intelligent machines

Bayesian Self-Organization Driven by Prior Probability Distributions

Bayesian inference by visuomotor neurons in prefrontal cortex

Context Exploitation using Hierarchical Bayesian Models

Bayesian modelling of visual discrimination learning in mice

Bayesian Inference for Radar Imagery Based Surveillance

Perceptual Stimulus — A Bayesian-based Integration of Multi-Visual-cue Approach and Its Application