Counterfactual Causality in Networks

Georgiana Caltais,Can Olmezoglu

DOI: https://doi.org/10.48550/arXiv.2211.00758

2022-11-01

Formal Languages and Automata Theory

Abstract:In this abstract we propose a framework for explaining violations of safety properties in Software Defined Networks, using counterfactual causal reasoning.

What problem does this paper attempt to address?

Counterfactual Causality from First Principles?

Gregor Gössler,Oleg Sokolsky,Jean-Bernard Stefani

DOI: https://doi.org/10.4204/EPTCS.259.5

2017-10-10

Abstract:In this position paper we discuss three main shortcomings of existing approaches to counterfactual causality from the computer science perspective, and sketch lines of work to try and overcome these issues: (1) causality definitions should be driven by a set of precisely specified requirements rather than specific examples; (2) causality frameworks should support system dynamics; (3) causality analysis should have a well-understood behavior in presence of abstraction.

Logic in Computer Science,Artificial Intelligence
Counterfactual Causality for Reachability and Safety based on Distance Functions

Julie Parreaux,Jakob Piribauer,Christel Baier

DOI: https://doi.org/10.4204/EPTCS.390.9

2023-10-02

Abstract:Investigations of causality in operational systems aim at providing human-understandable explanations of why a system behaves as it does. There is, in particular, a demand to explain what went wrong on a given counterexample execution that shows that a system does not satisfy a given specification. To this end, this paper investigates a notion of counterfactual causality in transition systems based on Stalnaker's and Lewis' semantics of counterfactuals in terms of most similar possible worlds and introduces a novel corresponding notion of counterfactual causality in two-player games. Using distance functions between paths in transition systems, this notion defines whether reaching a certain set of states is a cause for the violation of a reachability or safety property. Similarly, using distance functions between memoryless strategies in reachability and safety games, it is defined whether reaching a set of states is a cause for the fact that a given strategy for the player under investigation is losing. The contribution of the paper is two-fold: In transition systems, it is shown that counterfactual causality can be checked in polynomial time for three prominent distance functions between paths. In two-player games, the introduced notion of counterfactual causality is shown to be checkable in polynomial time for two natural distance functions between memoryless strategies. Further, a notion of explanation that can be extracted from a counterfactual cause and that pinpoints changes to be made to the given strategy in order to transform it into a winning strategy is defined. For the two distance functions under consideration, the problem to decide whether such an explanation imposes only minimal necessary changes to the given strategy with respect to the used distance function turns out to be coNP-complete and not to be solvable in polynomial time if P is not equal to NP, respectively.

Logic in Computer Science
Counterfactual-based Root Cause Analysis for Dynamical Systems

Juliane Weilbach,Sebastian Gerwinn,Karim Barsim,Martin Fränzle

2024-06-12

Abstract:Identifying the underlying reason for a failing dynamic process or otherwise anomalous observation is a fundamental challenge, yet has numerous industrial applications. Identifying the failure-causing sub-system using causal inference, one can ask the question: "Would the observed failure also occur, if we had replaced the behaviour of a sub-system at a certain point in time with its normal behaviour?" To this end, a formal description of behaviour of the full system is needed in which such counterfactual questions can be answered. However, existing causal methods for root cause identification are typically limited to static settings and focusing on additive external influences causing failures rather than structural influences. In this paper, we address these problems by modelling the dynamic causal system using a Residual Neural Network and deriving corresponding counterfactual distributions over trajectories. We show quantitatively that more root causes are identified when an intervention is performed on the structural equation and the external influence, compared to an intervention on the external influence only. By employing an efficient approximation to a corresponding Shapley value, we also obtain a ranking between the different subsystems at different points in time being responsible for an observed failure, which is applicable in settings with large number of variables. We illustrate the effectiveness of the proposed method on a benchmark dynamic system as well as on a real world river dataset.

Machine Learning
Causal inference over stochastic networks

Duncan A Clark,Mark S Handcock

DOI: https://doi.org/10.1093/jrsssa/qnae001

2024-01-25

Abstract:Abstract Claiming causal inferences in network settings necessitates careful consideration of the often complex dependency between outcomes for actors. Of particular importance are treatment spillover or outcome interference effects. We consider causal inference when the actors are connected via an underlying network structure. Our key contribution is a model for causality when the underlying network is endogenous; where the ties between actors and the actor covariates are statistically dependent. We develop a joint model for the relational and covariate generating process that avoids restrictive separability and fixed network assumptions, as these rarely hold in realistic social settings. While our framework can be used with general models, we develop the highly expressive class of Exponential-family Random Network models (ERNM) of which Markov random fields and Exponential-family Random Graph models are special cases. We present potential outcome-based inference within a Bayesian framework and propose a modification to the exchange algorithm to allow for sampling from ERNM posteriors. We present results of a simulation study demonstrating the validity of the approach. Finally, we demonstrate the value of the framework in a case study of smoking in the context of adolescent friendship networks.

statistics & probability,social sciences, mathematical methods
Transport-based Counterfactual Models

Lucas de Lara,Alberto González-Sanz,Nicholas Asher,Laurent Risser,Jean-Michel Loubes

DOI: https://doi.org/10.48550/arXiv.2108.13025

2023-01-07

Abstract:Counterfactual frameworks have grown popular in machine learning for both explaining algorithmic decisions but also defining individual notions of fairness, more intuitive than typical group fairness conditions. However, state-of-the-art models to compute counterfactuals are either unrealistic or unfeasible. In particular, while Pearl's causal inference provides appealing rules to calculate counterfactuals, it relies on a model that is unknown and hard to discover in practice. We address the problem of designing realistic and feasible counterfactuals in the absence of a causal model. We define transport-based counterfactual models as collections of joint probability distributions between observable distributions, and show their connection to causal counterfactuals. More specifically, we argue that optimal-transport theory defines relevant transport-based counterfactual models, as they are numerically feasible, statistically-faithful, and can coincide under some assumptions with causal counterfactual models. Finally, these models make counterfactual approaches to fairness feasible, and we illustrate their practicality and efficiency on fair learning. With this paper, we aim at laying out the theoretical foundations for a new, implementable approach to counterfactual thinking.

Artificial Intelligence
Causal Inference in Network Economics

Sridhar Mahadevan

DOI: https://doi.org/10.48550/arXiv.2109.11344

2021-09-21

Abstract:Network economics is the study of a rich class of equilibrium problems that occur in the real world, from traffic management to supply chains and two-sided online marketplaces. In this paper we explore causal inference in network economics, building on the mathematical framework of variational inequalities, which is a generalization of classical optimization. Our framework can be viewed as a synthesis of the well-known variational inequality formalism with the broad principles of causal inference

Optimization and Control,Artificial Intelligence
Efficient Discovery of Actual Causality using Abstraction-Refinement

Arshia Rafieioskouei,Borzoo Bonakdarpour

2024-08-31

Abstract:Causality is the relationship where one event contributes to the production of another, with the cause being partly responsible for the effect and the effect partly dependent on the cause. In this paper, we propose a novel and effective method to formally reason about the causal effect of events in engineered systems, with application for finding the root-cause of safety violations in embedded and cyber-physical systems. We are motivated by the notion of actual causality by Halpern and Pearl, which focuses on the causal effect of particular events rather than type-level causality, which attempts to make general statements about scientific and natural phenomena. Our first contribution is formulating discovery of actual causality in computing systems modeled by transition systems as an SMT solving problem. Since datasets for causality analysis tend to be large, in order to tackle the scalability problem of automated formal reasoning, our second contribution is a novel technique based on abstraction-refinement that allows identifying for actual causes within smaller abstract causal models. We demonstrate the effectiveness of our approach (by several orders of magnitude) using three case studies to find the actual cause of violations of safety in (1) a neural network controller for a Mountain Car, (2) a controller for a Lunar Lander obtained by reinforcement learning, and (3) an MPC controller for an F-16 autopilot simulator.

Logic in Computer Science,Systems and Control
On Causality in Distributed Continuum Systems

Víctor Casamayor Pujol,Boris Sedlak,Praveen Kumar Donta,Schahram Dustdar

DOI: https://doi.org/10.1109/mic.2023.3344248

IF: 2.68

2024-04-27

IEEE Internet Computing

Abstract:As distributed continuum systems (DCSs) are envisioned, they will have a massive impact on our future society. Hence, it is of utmost importance to ensure that their impact is socially responsible. Equipping these systems with causal models brings features such as explainability, accountability, and auditability, which are needed to provide the right level of trust. Furthermore, by combining causality with graph-based service-level objectives, we can cope with dynamic and complex system requirements while achieving sustainable development of DCSs' capacities and applications.

computer science, software engineering
Neural Causal Models for Counterfactual Identification and Estimation

Kevin Xia,Yushu Pan,Elias Bareinboim

DOI: https://doi.org/10.48550/arXiv.2210.00035

IF: 5.414

2022-09-30

Machine Learning

Abstract:Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the determination of blame and responsibility, credit assignment, and regret. In this paper, we study the evaluation of counterfactual statements through neural models. Specifically, we tackle two causal problems required to make such evaluations, i.e., counterfactual identification and estimation from an arbitrary combination of observational and experimental data. First, we show that neural causal models (NCMs) are expressive enough and encode the structural constraints necessary for performing counterfactual reasoning. Second, we develop an algorithm for simultaneously identifying and estimating counterfactual distributions. We show that this algorithm is sound and complete for deciding counterfactual identification in general settings. Third, considering the practical implications of these results, we introduce a new strategy for modeling NCMs using generative adversarial networks. Simulations corroborate with the proposed methodology.
Counterfactuals Modulo Temporal Logics

Bernd Finkbeiner,Julian Siber

DOI: https://doi.org/10.29007/qtw7

2023-06-15

Abstract:Lewis' theory of counterfactuals is the foundation of many contemporary notions of causality. In this paper, we extend this theory in the temporal direction to enable symbolic counterfactual reasoning on infinite sequences, such as counterexamples found by a model checker and trajectories produced by a reinforcement learning agent. In particular, our extension considers a more relaxed notion of similarity between worlds and proposes two additional counterfactual operators that close a semantic gap between the previous two in this more general setting. Further, we consider versions of counterfactuals that minimize the distance to the witnessing counterfactual worlds, a common requirement in causal analysis. To automate counterfactual reasoning in the temporal domain, we introduce a logic that combines temporal and counterfactual operators, and outline decision procedures for the satisfiability and trace-checking problems of this logic.

Logic in Computer Science,Artificial Intelligence
Efficient computation of counterfactual bounds

Marco Zaffalon,Alessandro Antonucci,Rafael Cabañas,David Huber,Dario Azzimonti

DOI: https://doi.org/10.1016/j.ijar.2023.109111

IF: 4.452

2024-01-05

International Journal of Approximate Reasoning

Abstract:We assume to be given structural equations over discrete variables inducing a directed acyclic graph, namely, a structural causal model , together with data about its internal nodes. The question we want to answer is how can we compute bounds for partially identifiable counterfactual queries from such an input. We start by giving a map from structural casual models to credal networks . This allows us to compute exact counterfactual bounds via algorithms for credal nets on a subclass of structural causal models. Exact computation is going to be inefficient in general given that, as we show, causal inference is NP-hard even on polytrees. We target then approximate bounds via a causal EM scheme. We evaluate their accuracy by providing credible intervals on the quality of the approximation; we show through a synthetic benchmark that the EM scheme delivers accurate results in a fair number of runs. In the course of the discussion, we also point out what seems to be a neglected limitation to the trending idea that counterfactual bounds can be computed without knowledge of the structural equations. We also present a real case study on palliative care to show how our algorithms can readily be used for practical purposes.

computer science, artificial intelligence
An Approach to Causal Inference over Stochastic Networks

Duncan A. Clark,Mark S. Handcock

DOI: https://doi.org/10.48550/arXiv.2106.14145

2022-07-15

Abstract:Claiming causal inferences in network settings necessitates careful consideration of the often complex dependency between outcomes for actors. Of particular importance are treatment spillover or outcome interference effects. We consider causal inference when the actors are connected via an underlying network structure. Our key contribution is a model for causality when the underlying network is unobserved and the actor covariates evolve stochastically over time. We develop a joint model for the relational and covariate generating process that avoids restrictive separability assumptions and deterministic network assumptions that do not hold in the majority of social network settings of interest. Our framework utilizes the highly general class of Exponential-family Random Network models (ERNM) of which Markov Random Fields (MRF) and Exponential-family Random Graph models (ERGM) are special cases. We present potential outcome based inference within a Bayesian framework, and propose a simple modification to the exchange algorithm to allow for sampling from ERNM posteriors. We present results of a simulation study demonstrating the validity of the approach. Finally, we demonstrate the value of the framework in a case-study of smoking over time in the context of adolescent friendship networks.

Methodology,Applications
Directed networks and resting-state effective brain connectivity with state-space reconstruction using reservoir computing causality

Falco-Roget,J.,Onicas,A. I.,Akwasi-Sarpong,F.,Crimi,A.

DOI: https://doi.org/10.1101/2023.06.08.544175

2023-06-10

bioRxiv

Abstract:Causality theory is a complex field involving philosophy, mathematics, and computer science. It relies on the temporal precedence of cause over a consequence or unidirectional propagation of changes. Despite these simple principles, normative modeling of causal relationships is conceptually and computationally challenging. Model-free approaches provide insights into large, complex, and chaotic networks, but suffer from false positive and false negative inferences caused by meaningless statistical and temporal correlations. Machine learning advancements have extended these data-driven methods to nonlinear systems, yet inherited similar drawbacks as linear approaches. Interestingly, newer proposals within this model-free paradigm reverse the temporal precedence using the internal structure of the driven variable to recover information from the driving one. Efficient machine learning models combined with these state space reconstruction methods automate part of the process, potentially reducing inductive biases during training and inference. However, their translation into neuroscience, especially neuroimaging, is limited due to complex interpretations and a lack of systematic analyses of the results. Here, we exploited these methods combining them with normative analyses to reconstruct chaotic relationships and networks emerging from neuroimaging data. We validated the proposed scores with a chaotic yet solved system and rebuilt brain networks both in synthetic and real scenarios. We compared our method and heuristics with well-established alternatives providing a comprehensive and transparent benchmark. We obtained higher accuracies and reduced false inferences compared to Granger causality in tasks with known ground truth. When tested to unravel directed influences in brain networks meaningful predictions were found to exist between nodes from the default mode network. The presented framework explores reservoir computing for causality detection, offering a conceptual detour from traditional premises and has the potential to provide theoretical guidance opening perspectives for studying cognition and neuropathologies.
Using counterfactuals in knowledge-based programming

Joseph Y. Halpern,Yoram Moses,JosephY. Halpern

DOI: https://doi.org/10.1007/s00446-004-0108-1

2004-08-01

Distributed Computing

Abstract:Abstract.This paper adds counterfactuals to the framework of knowledge-based programs of Fagin, Halpern, Moses, and Vardi [3,4]. The use of counterfactuals is illustrated by designing a protocol in which an agent stops sending messages once it knows that it is safe to do so. Such behavior is difficult to capture in the original framework because it involves reasoning about counterfactual executions, including ones that are not consistent with the protocol. Attempts to formalize these notions without counterfactuals are shown to lead to rather counterintuitive behavior.

computer science, theory & methods
The Counterfactual NESS Definition of Causation

Sander Beckers

DOI: https://doi.org/10.48550/arXiv.2012.05123

2020-12-16

Abstract:In previous work with Joost Vennekens I proposed a definition of actual causation that is based on certain plausible principles, thereby allowing the debate on causation to shift away from its heavy focus on examples towards a more systematic analysis. This paper contributes to that analysis in two ways. First, I show that our definition is in fact a formalization of Wright's famous NESS definition of causation combined with a counterfactual difference-making condition. This means that our definition integrates two highly influential approaches to causation that are claimed to stand in opposition to each other. Second, I modify our definition to offer a substantial improvement: I weaken the difference-making condition in such a way that it avoids the problematic analysis of cases of preemption. The resulting Counterfactual NESS definition of causation forms a natural compromise between counterfactual approaches and the NESS approach.

Artificial Intelligence
Causality in Neural Networks -- An Extended Abstract

Abbavaram Gowtham Reddy

DOI: https://doi.org/10.1145/3461702.3462467

2021-06-03

Abstract:Causal reasoning is the main learning and explanation tool used by humans. AI systems should possess causal reasoning capabilities to be deployed in the real world with trust and reliability. Introducing the ideas of causality to machine learning helps in providing better learning and explainable models. Explainability, causal disentanglement are some important aspects of any machine learning model. Causal explanations are required to believe in a model's decision and causal disentanglement learning is important for transfer learning applications. We exploit the ideas of causality to be used in deep learning models to achieve better and causally explainable models that are useful in fairness, disentangled representation, etc.

Machine Learning,Artificial Intelligence
(De-)Composing Causality in Labeled Transition Systems

Georgiana Caltais,Stefan Leue,Mohammad Reza Mousavi

DOI: https://doi.org/10.4204/EPTCS.224.3

2016-08-29

Abstract:In this paper we introduce a notion of counterfactual causality in the Halpern and Pearl sense that is compositional with respect to the interleaving of transition systems. The formal framework for reasoning on what caused the violation of a safety property is established in the context of labeled transition systems and Hennessy Milner logic. The compositionality results are devised for non-communicating systems.

Logic in Computer Science
Topological reversibility and causality in feed-forward networks

Bernat Corominas-Murtra,Carlos Rodríguez-Caso,Joaquín Goñi,Ricard Solé

DOI: https://doi.org/10.48550/arXiv.1007.1829

2010-07-12

Abstract:Systems whose organization displays causal asymmetry constraints, from evolutionary trees to river basins or transport networks, can be often described in terms of directed paths (causal flows) on a discrete state space. Such a set of paths defines a feed-forward, acyclic network. A key problem associated with these systems involves characterizing their intrinsic degree of path reversibility: given an end node in the graph, what is the uncertainty of recovering the process backwards until the origin? Here we propose a novel concept, \textit{topological reversibility}, which rigorously weigths such uncertainty in path dependency quantified as the minimum amount of information required to successfully revert a causal path. Within the proposed framework we also analytically characterize limit cases for both topologically reversible and maximally entropic structures. The relevance of these measures within the context of evolutionary dynamics is highlighted.

Disordered Systems and Neural Networks,Statistical Mechanics
Spatio-Temporal Graphical Counterfactuals: An Overview

Mingyu Kang,Duxin Chen,Ziyuan Pu,Jianxi Gao,Wenwu Yu

2024-07-02

Abstract:Counterfactual thinking is a critical yet challenging topic for artificial intelligence to learn knowledge from data and ultimately improve their performances for new scenarios. Many research works, including Potential Outcome Model and Structural Causal Model, have been proposed to realize it. However, their modelings, theoretical foundations and application approaches are usually different. Moreover, there is a lack of graphical approach to infer spatio-temporal counterfactuals, that considers spatial and temporal interactions between multiple units. Thus, in this work, our aim is to investigate a survey to compare and discuss different counterfactual models, theories and approaches, and further build a unified graphical causal frameworks to infer the spatio-temporal counterfactuals.

Artificial Intelligence
Bayesian Causal Network for Discrete Variables

Wang Jing,Jinglin Zhou,Xiaolu Chen

DOI: https://doi.org/10.1007/978-981-16-8044-1_13

2022-01-01

Abstract:Ensuring the safety of industrial systems requires not only detecting the faults, but also locating them so that they can be eliminated. The previous chapters have discussed the fault detection and identification methods. Fault traceability is also an important issue in industrial system. This chapter and Chap. 10.1007/978-981-16-8044-1_14 aim at the fault inference and root tracking based on the probabilistic graphical model. This model explores the internal linkages of system variables quantitatively and qualitatively, so it avoids the bottleneck of multivariate statistical model without clear mechanism. The exacted features or principle components of multivariate statistical model are linear or nonlinear combinations of system variables and have not any physical meaning. So the multivariate statistical model is good at fault detection and identification, but not at fault root tracking.

Counterfactual Causality in Networks

Counterfactual Causality from First Principles?

Counterfactual Causality for Reachability and Safety based on Distance Functions

Counterfactual-based Root Cause Analysis for Dynamical Systems

Causal inference over stochastic networks

Transport-based Counterfactual Models

Causal Inference in Network Economics

Efficient Discovery of Actual Causality using Abstraction-Refinement

On Causality in Distributed Continuum Systems

Neural Causal Models for Counterfactual Identification and Estimation

Counterfactuals Modulo Temporal Logics

Efficient computation of counterfactual bounds

An Approach to Causal Inference over Stochastic Networks

Directed networks and resting-state effective brain connectivity with state-space reconstruction using reservoir computing causality

Using counterfactuals in knowledge-based programming

The Counterfactual NESS Definition of Causation

Causality in Neural Networks -- An Extended Abstract

(De-)Composing Causality in Labeled Transition Systems

Topological reversibility and causality in feed-forward networks

Spatio-Temporal Graphical Counterfactuals: An Overview

Bayesian Causal Network for Discrete Variables