Abstract:Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales. Bayesian inference is essential for predicting noisy inputs in the environment and is suggested to be common in various animals, including humans. For the brain, to perform Bayesian inference, the prior distribution of the signal must be acquired and represented in the neural networks by sampling noisy inputs to estimate the posterior distribution of signals. By training recurrent neural networks to predict time-varying inputs, we demonstrated that those with modular structures, characterized by the main module exhibiting faster neural activity and the sub-module exhibiting slower neural activity, achieved highly accurate Bayesian inference to perform the required task. In this network, the prior distribution was specifically represented by the slower sub-module, which effectively integrated the earlier inputs. Furthermore, this modular structure with different time scales and division of representing roles emerged spontaneously through the learning process of Bayesian inference. Our results demonstrate a general mechanism for encoding prior distributions and highlight the importance of the brain's modular structure with time scale differentiation for Bayesian information processing.

Neural substrate of dynamic Bayesian inference in the cerebral cortex

Inference on the Macroscopic Dynamics of Spiking Neurons

Bayesian inference by visuomotor neurons in prefrontal cortex

The parieto-occipital cortex is a candidate neural substrate for the human ability to approximate Bayesian inference

Dynamical latent state computation in the male macaque posterior parietal cortex

The "Bayesian" brain, with a bit less Bayes

Bayesian inference is facilitated by modular neural networks with different time scales

Sampling-based Bayesian Inference in Recurrent Circuits of Stochastic Spiking Neurons

Model-Based Bayesian Inference of Neural Activity and Connectivity from All-Optical Interrogation of A Neural Circuit

Dynamic Causal Modeling in Probabilistic Programming Languages

The principles of adaptation in organisms and machines II: Thermodynamics of the Bayesian brain

To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference

Neural dynamics of causal inference in the macaque frontoparietal circuit

Neuronal Sequence Models for Bayesian Online Inference

Unveiling Dynamic System Strategies for Multisensory Processing: from Neuronal Fixed-Criterion Integration to Population Bayesian Inference

Bayesian brain theory: Computational neuroscience of belief

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Stable Neural Population Dynamics in the Regression Subspace for Continuous and Categorical Task Parameters in Monkeys.

Neural representation of probabilities for Bayesian inference

Bayesian modelling of visual discrimination learning in mice

Sub-threshold neuronal activity and the dynamical regime of cerebral cortex