Solving the causal inference problem

Uta Noppeney

DOI: https://doi.org/10.1016/j.tics.2021.09.004

Abstract:Perception requires the brain to infer whether signals arise from common causes and should hence be integrated or else be treated independently. Rideaux et al. show that a feedforward network can perform causal inference in visuovestibular motion estimation by reading out activity from neurons tuned to congruent and opposite directions.

What problem does this paper attempt to address?

Causal inference in perception

Ladan Shams,Ulrik R. Beierholm

DOI: https://doi.org/10.1016/j.tics.2010.07.001

IF: 19.9

2010-09-01

Trends in Cognitive Sciences

Abstract:Until recently, the question of how the brain performs causal inference has been studied primarily in the context of cognitive reasoning. However, this problem is at least equally crucial in perceptual processing. At any given moment, the perceptual system receives multiple sensory signals within and across modalities and, for example, has to determine the source of each of these signals. Recently, a growing number of studies from various fields of cognitive science have started to address this question and have converged to very similar computational models. Therefore, it seems that a common computational strategy, which is highly consistent with a normative model of causal inference, is exploited by the perceptual system in a variety of domains.

behavioral sciences,psychology, experimental,neurosciences
Neural dynamics of causal inference in the macaque frontoparietal circuit

Guangyao Qi,Wen Fang,Shenghao Li,Junru Li,Liping Wang

DOI: https://doi.org/10.7554/elife.76145

IF: 7.7

2022-10-25

eLife

Abstract:Natural perception relies inherently on inferring causal structure in the environment. However, the neural mechanisms and functional circuits essential for representing and updating the hidden causal structure and corresponding sensory representations during multisensory processing are unknown. To address this, monkeys were trained to infer the probability of a potential common source from visual and proprioceptive signals based on their spatial disparity in a virtual reality system. The proprioceptive drift reported by monkeys demonstrated that they combined previous experience and current multisensory signals to estimate the hidden common source and subsequently updated the causal structure and sensory representation. Single-unit recordings in premotor and parietal cortices revealed that neural activity in the premotor cortex represents the core computation of causal inference, characterizing the estimation and update of the likelihood of integrating multiple sensory inputs at a trial-by-trial level. In response to signals from the premotor cortex, neural activity in the parietal cortex also represents the causal structure and further dynamically updates the sensory representation to maintain consistency with the causal inference structure. Thus, our results indicate how the premotor cortex integrates previous experience and sensory inputs to infer hidden variables and selectively updates sensory representations in the parietal cortex to support behavior. This dynamic loop of frontal-parietal interactions in the causal inference framework may provide the neural mechanism to answer long-standing questions regarding how neural circuits represent hidden structures for body awareness and agency.

biology
Multisensory Causal Inference in the Brain

Christoph Kayser,Ladan Shams

DOI: https://doi.org/10.1371/journal.pbio.1002075

IF: 9.8

2015-02-24

PLoS Biology

Abstract:At any given moment, our brain processes multiple inputs from its different sensory modalities (vision, hearing, touch, etc.). In deciphering this array of sensory information, the brain has to solve two problems: (1) which of the inputs originate from the same object and should be integrated and (2) for the sensations originating from the same object, how best to integrate them. Recent behavioural studies suggest that the human brain solves these problems using optimal probabilistic inference, known as Bayesian causal inference. However, how and where the underlying computations are carried out in the brain have remained unknown. By combining neuroimaging-based decoding techniques and computational modelling of behavioural data, a new study now sheds light on how multisensory causal inference maps onto specific brain areas. The results suggest that the complexity of neural computations increases along the visual hierarchy and link specific components of the causal inference process with specific visual and parietal regions.

biochemistry & molecular biology,biology
To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference

Máté Aller,Uta Noppeney

DOI: https://doi.org/10.1371/journal.pbio.3000210

IF: 9.8

2019-04-02

PLoS Biology

Abstract:To form a percept of the environment, the brain needs to solve the binding problem-inferring whether signals come from a common cause and are integrated or come from independent causes and are segregated. Behaviourally, humans solve this problem near-optimally as predicted by Bayesian causal inference; but the neural mechanisms remain unclear. Combining Bayesian modelling, electroencephalography (EEG), and multivariate decoding in an audiovisual spatial localisation task, we show that the brain accomplishes Bayesian causal inference by dynamically encoding multiple spatial estimates. Initially, auditory and visual signal locations are estimated independently; next, an estimate is formed that combines information from vision and audition. Yet, it is only from 200 ms onwards that the brain integrates audiovisual signals weighted by their bottom-up sensory reliabilities and top-down task relevance into spatial priority maps that guide behavioural responses. As predicted by Bayesian causal inference, these spatial priority maps take into account the brain's uncertainty about the world's causal structure and flexibly arbitrate between sensory integration and segregation. The dynamic evolution of perceptual estimates thus reflects the hierarchical nature of Bayesian causal inference, a statistical computation, which is crucial for effective interactions with the environment.

biochemistry & molecular biology,biology
A Normative Theory for Causal Inference and Bayes Factor Computation in Neural Circuits

Wen-Hao Zhang,Si Wu,Brent Doiron,Tai Sing Lee

2019-01-01

Abstract:This study provides a normative theory for how Bayesian causal inference can be implemented in neural circuits. In both cognitive processes such as causal reasoning and perceptual inference such as cue integration, the nervous systems need to choose different models representing the underlying causal structures when making inferences on external stimuli. In multisensory processing, for example, the nervous system has to choose whether to integrate or segregate inputs from different sensory modalities to infer the sensory stimuli, based on whether the inputs are from the same or different sources. Making this choice is a model selection problem requiring the computation of Bayes factor, the ratio of likelihoods between the integration and the segregation models. In this paper, we consider the causal inference in multisensory processing and propose a novel generative model based on neural population code that takes into account both stimulus feature and stimulus reliability in the inference. In the case of circular variables such as heading direction, our normative theory yields an analytical solution for computing the Bayes factor, with a clear geometric interpretation, which can be implemented by simple additive mechanisms with neural population code. Numerical simulation shows that the tunings of the neurons computing Bayes factor are consistent with the "opposite neurons" discovered in dorsal medial superior temporal (MSTd) and the ventral intraparietal (VIP) areas for visual-vestibular processing. This study illuminates a potential neural mechanism for causal inference in the brain.
The Causal-Neural Connection: Expressiveness, Learnability, and Inference

Kevin Xia,Kai-Zhan Lee,Yoshua Bengio,Elias Bareinboim

DOI: https://doi.org/10.48550/arXiv.2107.00793

IF: 5.414

2021-07-02

Machine Learning

Abstract:One of the central elements of any causal inference is an object called structural causal model (SCM), which represents a collection of mechanisms and exogenous sources of random variation of the system under investigation (Pearl, 2000). An important property of many kinds of neural networks is universal approximability: the ability to approximate any function to arbitrary precision. Given this property, one may be tempted to surmise that a collection of neural nets is capable of learning any SCM by training on data generated by that SCM. In this paper, we show this is not the case by disentangling the notions of expressivity and learnability. Specifically, we show that the causal hierarchy theorem (Thm. 1, Bareinboim et al., 2020), which describes the limits of what can be learned from data, still holds for neural models. For instance, an arbitrarily complex and expressive neural net is unable to predict the effects of interventions given observational data alone. Given this result, we introduce a special type of SCM called a neural causal model (NCM), and formalize a new type of inductive bias to encode structural constraints necessary for performing causal inferences. Building on this new class of models, we focus on solving two canonical tasks found in the literature known as causal identification and estimation. Leveraging the neural toolbox, we develop an algorithm that is both sufficient and necessary to determine whether a causal effect can be learned from data (i.e., causal identifiability); it then estimates the effect whenever identifiability holds (causal estimation). Simulations corroborate the proposed approach.
Causal inference predicts the transition from integration to segmentation in motion perception

Boris Penaloza,Sabyasachi Shivkumar,Gabor Lengyel,Gregory C. DeAngelis,Ralf M. Haefner

DOI: https://doi.org/10.1038/s41598-024-78820-6

IF: 4.6

2024-11-14

Scientific Reports

Abstract:Motion provides a powerful sensory cue for segmenting a visual scene into objects and inferring the causal relationships between objects. Fundamental mechanisms involved in this process are the integration and segmentation of local motion signals. However, the computations that govern whether local motion signals are perceptually integrated or segmented remain unclear. Hierarchical Bayesian causal inference has recently been proposed as a model for these computations, yet a hallmark prediction of the model – its dependency on sensory uncertainty – has remained untested. We used a recently developed hierarchical stimulus configuration to measure how human subjects integrate or segment local motion signals while manipulating motion coherence to control sensory uncertainty. We found that (a) the perceptual transition from motion integration to segmentation shifts with sensory uncertainty, and (b) that perceptual variability is maximal around this transition point. Both findings were predicted by the model and challenge conventional interpretations of motion repulsion effects.

multidisciplinary sciences
Closing the loop on multisensory interactions: A neural architecture for multisensory causal inference and recalibration

Jonathan Tong,German I. Parisi,Stefan Wermter,Brigitte Röder

DOI: https://doi.org/10.48550/arXiv.1802.06591

2018-02-19

Neural and Evolutionary Computing

Abstract:When the brain receives input from multiple sensory systems, it is faced with the question of whether it is appropriate to process the inputs in combination, as if they originated from the same event, or separately, as if they originated from distinct events. Furthermore, it must also have a mechanism through which it can keep sensory inputs calibrated to maintain the accuracy of its internal representations. We have developed a neural network architecture capable of i) approximating optimal multisensory spatial integration, based on Bayesian causal inference, and ii) recalibrating the spatial encoding of sensory systems. The architecture is based on features of the dorsal processing hierarchy, including the spatial tuning properties of unisensory neurons and the convergence of different sensory inputs onto multisensory neurons. Furthermore, we propose that these unisensory and multisensory neurons play dual roles in i) encoding spatial location as separate or integrated estimates and ii) accumulating evidence for the independence or relatedness of multisensory stimuli. We further propose that top-down feedback connections spanning the dorsal pathway play key a role in recalibrating spatial encoding at the level of early unisensory cortices. Our proposed architecture provides possible explanations for a number of human electrophysiological and neuroimaging results and generates testable predictions linking neurophysiology with behaviour.
Sampling-based Causal Inference in Cue Combination and its Neural Implementation

Zhaofei Yu,Feng Chen,Jianwu Dong,Qionghai Dai

DOI: https://doi.org/10.48550/arXiv.1509.00998

2015-09-03

Abstract:Causal inference in cue combination is to decide whether the cues have a single cause or multiple causes. Although the Bayesian causal inference model explains the problem of causal inference in cue combination successfully, how causal inference in cue combination could be implemented by neural circuits, is unclear. The existing method based on calculating log posterior ratio with variable elimination has the problem of being unrealistic and task-specific. In this paper, we take advantages of the special structure of the Bayesian causal inference model and propose a hierarchical inference algorithm based on importance sampling. A simple neural circuit is designed to implement the proposed inference algorithm. Theoretical analyses and experimental results demonstrate that our algorithm converges to the accurate value as the sample size goes to infinite. Moreover, the neural circuit we design can be easily generalized to implement inference for other problems, such as the multi-stimuli cause inference and the same-different judgment.

Neural and Evolutionary Computing,Neurons and Cognition
How relevant is the prior? Bayesian causal inference for dynamic perception in volatile environments

David Meijer,Roberto Barumerli,Robert Baumgartner

DOI: https://doi.org/10.1101/2024.10.29.620874

2024-10-29

Abstract:Our brains predict future sensory input based on their current beliefs about the world around us, but interpreting prediction errors can be challenging in a volatile environment because they can be caused by stochastic noise or by outdated predictions. Noisy signals should be integrated with prior beliefs to improve precision, but the two should be segregated when environmental changes render prior beliefs irrelevant. Bayesian inference provides a statistically optimal solution to deal with situations in which there is uncertainty about the cause of the prediction errors. However, the method quickly becomes memory intensive and computationally intractable when applied consecutively. Here, we systematically evaluate the predictive performance of Bayesian causal inference for human perceptual decisions in a spatial prediction task based on noisy audiovisual sequences with occasional changepoints. We elucidate the simplifying assumptions of a previously proposed reduced Bayesian observer model, and we compare it to an extensive set of models based on alternative simplification strategies. Model-free analyses revealed the hallmarks of Bayesian causal inference: participants seem to have integrated sensory evidence with prior beliefs to improve accuracy when prediction errors were small, and prior influence gradually decreased as prediction errors grew larger, signalling probable irrelevance of the prior due to a changepoint. Model comparison results further supported the hypotheses that participants computed probability-weighted averages over the causal options (noise or changepoint) and that they iteratively summarized their beliefs while accounting for causal uncertainty akin to the reduced Bayesian observer model. However, we also found that participants' reliance on prior beliefs was systematically smaller than predicted by the model, and this was best explained by individually fitting lower-than-optimal parameters for the a-priori probability of prior relevance. We conclude that perceptual belief updating in volatile environments with stochastic noise is well described by a simplified model of consecutive Bayesian causal inference. Observers utilize priors flexibly to the extent that they are deemed relevant, though also conservatively with a lower tendency to bind than an ideal Bayesian observer.

Neuroscience
A unified neural circuit of causal inference and multisensory integration

Ying Fang,Zhaofei Yu,Jian K. Liu,Feng Chen

DOI: https://doi.org/10.1016/j.neucom.2019.05.067

IF: 6

2019-01-01

Neurocomputing

Abstract:•The first unified neural model of information fusion in perception is proposed.•A unified theoretical formalization of different perceptual tasks is present.•The reasonable neural circuit can calculate intractable posterior distribution.•The neural model performs Bayesian inference optimally is strictly proved.•Divisive normalization in cortex is linked to Bayesian posterior distribution.
Social cues help us construct the causal perception of physical events

jifan zhou,zaifeng gao,ning tang,mowei shen

DOI: https://doi.org/10.1167/12.9.156

2012-01-01

Journal of Vision

Abstract:In simple mechanical events, our visual system is able to automatically infer the causal stucture of events and yield causal impressions. Physical cues (especially spatiotemporal features of the display) are found to be the key factors of the causal perception. Here we demonstrate that cues of a completely different domain – the social cues -- also impact the causal perception of physical events: the causally ambiguous events are more likely to be perceived as causal if the faces super-imposed on the objects change from neutral to fearful. This effect has following three major properties: (1) the effect is caused by the social information, because it disappears when the faces are inverted or when the expression-changes are unreasonable; (2) merely the change of basic physical features, such as color and shape, can not influence the causal perception; (3) the social cues are integrated in a temporal window different from physical cues; (4) the social cues impact the perception process rather than the decision process as the impact also appears in the causality-induced illusion. These findings suggest that the visual system also relies on social information to infer the causal structure of the physical world. Meeting abstract presented at VSS 2012
Learning perceptual causality from video

Amy Fire,Song-Chun Zhu

2013-01-01

Abstract:Computer vision and artificial intelligence research has long danced around the subject of causality: vision researchers use causal relationships to aid action detection, and AI researchers propose methods for causal induction independent of video sensors. In this paper, we argue that learning perceptual causality from video is a necessary step for understanding scenes in video. We explain how current object and action detection is suffering without causality, and we explain how current causality research is suffering without grounding on raw sensors. We then go on to describe one plausible solution for grounding perceptual causality on raw sensors.
Hierarchical motion perception as causal inference

Sabyasachi Shivkumar,Gregory C. DeAngelis,Ralf M. Haefner

DOI: https://doi.org/10.1101/2023.11.18.567582

2024-10-19

Abstract:Since motion can only be defined relative to a reference frame, which reference frame guides perception? A century of psychophysical studies has produced conflicting evidence: retinotopic, egocentric, world-centric, or even object-centric. We introduce a hierarchical Bayesian model mapping retinal velocities to perceived velocities. Our model mirrors the structure in the world, in which visual elements move within causally connected reference frames. Friction renders velocities in these reference frames mostly stationary, formalized by an additional delta component (at zero) in the prior. Inverting this model automatically segments visual inputs into groups, groups into supergroups, etc., and "perceives" motion in the appropriate reference frame. Critical model predictions are supported by two new experiments, and fitting our model to the data allows us to infer the subjective set of reference frames used by individual observers. Our model provides a quantitative normative justification for key Gestalt principles providing inspiration for building better models of visual processing in general.

Animal Behavior and Cognition
Invariance & Causal Representation Learning: Prospects and Limitations

Simon Bing,Jonas Wahl,Urmi Ninad,Jakob Runge

2023-12-07

Abstract:In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables of interest are latent are largely missing. We assay the connection between invariance and causal representation learning by establishing impossibility results which show that invariance alone is insufficient to identify latent causal variables. Together with practical considerations, we use these theoretical findings to highlight the need for additional constraints in order to identify representations by exploiting invariance.

Artificial Intelligence,Machine Learning
A causal inference approach of monosynapses from spike trains

Zach Saccomano,Sam Mckenzie,Horacio Rotstein,Asohan Amarasingham

2024-05-05

Abstract:Neuroscientists have worked on the problem of estimating synaptic properties, such as connectivity and strength, from simultaneously recorded spike trains since the 1960s. Recent years have seen renewed interest in the problem, coinciding with rapid advances in the technology of high-density neural recordings and optogenetics, which can be used to calibrate causal hypotheses about functional connectivity. Here, a rigorous causal inference framework for pairwise excitatory and inhibitory monosynaptic effects between spike trains is developed. Causal interactions are identified by separating spike interactions in pairwise spike trains by their timescales. Fast algorithms for computing accurate estimates of associated quantities are also developed. Through the lens of this framework, the link between biophysical parameters and statistical definitions of causality between spike trains is examined across a spectrum of dynamical systems simulations. In an idealized setting, we demonstrate a correspondence between the synaptic causal metric developed here and the probabilities of causation developed by Tian and Pearl. Since the probabilities of causation are derived under distinct assumptions and include data from experimental randomization, this opens up the possibility of testing the synaptic inference framework's assumptions with juxtacellular or optogenetic stimulation. We simulate such an experiment with a biophysically detailed channelrhodopsin model and show that randomization is not achieved; strong confounding persists even with strong stimulations. A principal goal is to ask how carefully articulated causal assumptions might better inform the design of neural stimulation experiments and, in turn, support experimental tests of those assumptions.

Neurons and Cognition
Inferring occluded projectile motion changes connectivity within a visuo-fronto-parietal network

Gabrielle Aude Zbären,Manu Kapur,Sarah Nadine Meissner,Nicole Wenderoth

DOI: https://doi.org/10.1007/s00429-024-02815-2

2024-06-26

Brain Structure and Function

Abstract:Anticipating the behaviour of moving objects in the physical environment is essential for a wide range of daily actions. This ability is thought to rely on mental simulations and has been shown to involve frontoparietal and early visual areas. Yet, the connectivity patterns between these regions during intuitive physical inference remain largely unknown. In this study, participants underwent fMRI while performing a task requiring them to infer the parabolic trajectory of an occluded ball falling under Newtonian physics, and a control task. Building on our previous research showing that when solving the physical inference task, early visual areas encode task-specific and perception-like information about the inferred trajectory, the present study aimed to (i) identify regions that are functionally coupled with early visual areas during the physical inference task, and (ii) investigate changes in effective connectivity within this network of regions. We found that early visual areas are functionally connected to a set of parietal and premotor regions when inferring occluded trajectories. Using dynamic causal modelling, we show that predicting occluded trajectories is associated with changes in effective connectivity within a parieto-premotor network, which may drive internally generated early visual activity in a top-down fashion. These findings offer new insights into the interaction between early visual and frontoparietal regions during physical inference, contributing to our understanding of the neural mechanisms underlying the ability to predict physical outcomes.

neurosciences,anatomy & morphology
Forward and backward inference in spatial cognition

Will D Penny,Peter Zeidman,Neil Burgess

DOI: https://doi.org/10.1371/journal.pcbi.1003383

Abstract:This paper shows that the various computations underlying spatial cognition can be implemented using statistical inference in a single probabilistic model. Inference is implemented using a common set of 'lower-level' computations involving forward and backward inference over time. For example, to estimate where you are in a known environment, forward inference is used to optimally combine location estimates from path integration with those from sensory input. To decide which way to turn to reach a goal, forward inference is used to compute the likelihood of reaching that goal under each option. To work out which environment you are in, forward inference is used to compute the likelihood of sensory observations under the different hypotheses. For reaching sensory goals that require a chaining together of decisions, forward inference can be used to compute a state trajectory that will lead to that goal, and backward inference to refine the route and estimate control signals that produce the required trajectory. We propose that these computations are reflected in recent findings of pattern replay in the mammalian brain. Specifically, that theta sequences reflect decision making, theta flickering reflects model selection, and remote replay reflects route and motor planning. We also propose a mapping of the above computational processes onto lateral and medial entorhinal cortex and hippocampus.
Entropic Causal Inference for Neurological Applications

Jeremie Fish,Alexander DeWitt,Abd AlRahman R. AlMomani,Paul J. Laurienti,Erik Bollt

DOI: https://doi.org/10.1063/5.0039333

2021-02-04

Abstract:The ultimate goal of cognitive neuroscience is to understand the mechanistic neural processes underlying the functional organization of the brain. Key to this study is understanding structure of both the structural and functional connectivity between anatomical regions. In this paper we follow previous work in developing a simple dynamical model of the brain by simulating its various regions as Kuramoto oscillators whose coupling structure is described by a complex network. However in our simulations rather than generating synthetic networks, we simulate our synthetic model but coupled by a real network of the anatomical brain regions which has been reconstructed from diffusion tensor imaging (DTI) data. By using an information theoretic approach that defines direct information flow in terms of causation entropy (CSE), we show that we can more accurately recover the true structural network than either of the popular correlation or LASSO regression techniques. We demonstrate the effectiveness of our method when applied to data simulated on the realistic DTI network, as well as on randomly generated small-world and Erdös-Rényi (ER) networks.

Neurons and Cognition,Dynamical Systems

Solving the causal inference problem

Causal inference in perception

Neural dynamics of causal inference in the macaque frontoparietal circuit

Multisensory Causal Inference in the Brain

To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference

A Normative Theory for Causal Inference and Bayes Factor Computation in Neural Circuits

The Causal-Neural Connection: Expressiveness, Learnability, and Inference

Causal inference predicts the transition from integration to segmentation in motion perception

Closing the loop on multisensory interactions: A neural architecture for multisensory causal inference and recalibration

Sampling-based Causal Inference in Cue Combination and its Neural Implementation

How relevant is the prior? Bayesian causal inference for dynamic perception in volatile environments

A unified neural circuit of causal inference and multisensory integration

Social cues help us construct the causal perception of physical events

Learning perceptual causality from video

Hierarchical motion perception as causal inference

Invariance & Causal Representation Learning: Prospects and Limitations

A causal inference approach of monosynapses from spike trains

Inferring occluded projectile motion changes connectivity within a visuo-fronto-parietal network

Forward and backward inference in spatial cognition

Entropic Causal Inference for Neurological Applications