Abstract:The abilities of humans to understand the world in terms of cause and effect relationships, as well as to compress information into abstract concepts, are two hallmark features of human intelligence. These two topics have been studied in tandem in the literature under the rubric of causal abstractions theory. In practice, it remains an open problem how to best leverage abstraction theory in real-world causal inference tasks, where the true mechanisms are unknown and only limited data is available. In this paper, we develop a new family of causal abstractions by clustering variables and their domains. This approach refines and generalizes previous notions of abstractions to better accommodate individual causal distributions that are spawned by Pearl's causal hierarchy. We show that such abstractions are learnable in practical settings through Neural Causal Models (Xia et al., 2021), enabling the use of the deep learning toolkit to solve various challenging causal inference tasks -- identification, estimation, sampling -- at different levels of granularity. Finally, we integrate these results with representation learning to create more flexible abstractions, moving these results closer to practical applications. Our experiments support the theory and illustrate how to scale causal inferences to high-dimensional settings involving image data.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the problem of how to use causal abstraction theory in practical causal inference tasks when the real mechanism is unknown and only limited data is available. Specifically, the author proposes a new family of causal abstractions, which improves and generalizes previous abstraction concepts by clustering variables and their domains, making it better adapt to the individual causal distributions generated by Pearl's causal hierarchy. #### Problem background 1. **Two key features of human intelligence**: - Understanding causal relationships in the world. - The ability to compress information into abstract concepts. 2. **Existing challenges**: - In real - world causal inference tasks, how to best utilize the abstraction theory remains an open question. - The real mechanism is usually unknown and only limited data is available. 3. **Research objectives**: - Develop a new causal abstraction method to improve and generalize previous abstraction concepts by clustering variables and their domains. - Use Neural Causal Models (NCM) to learn these abstractions, enabling deep - learning tools to solve various complex causal inference tasks (such as identification, estimation, sampling). - Combine these results with representation learning to create more flexible abstractions that are closer to practical applications. #### Specific problems The specific problems that the paper attempts to solve are: how to learn the causal abstraction model of high - level variables \( V_H \) from low - level variables \( V_L \), so that the high - level model can replace the low - level model for reasoning in causal inference tasks at different levels. Specifically: - **Define a new abstraction function**: Based on the clustering of variables and their value ranges, define a constructive abstraction function \( \tau \), which maps low - level variables to high - level variables. - **Ensure consistency**: Ensure that the query results of the high - level model \( M_H \) on the given data are consistent with the results of the low - level model \( M_L \), especially on different levels of the causal hierarchy (observation, intervention, counterfactual). - **Practical application**: Verify the effectiveness of the proposed method in high - dimensional settings (such as image data) through experiments. #### Example illustration For example, an economist studies the impact of consumption trends in various countries on the average income \( Y \). Besides \( Y \), she also collects observational data on consumer spending \( C \), investment \( I \), government spending \( G \), imports \( M \) and exports \( E \). She hopes to understand the impact on the average income by increasing the total expenditure level. However, these variables can be aggregated into a high - level variable - Gross Domestic Product (GDP). The tools provided by the paper allow her to build a high - level model \( cM_H \), encode the required causal assumptions, and train the model on the given observational data, so as to query the causal effect of GDP on \( Y \). ### Summary The main contributions of this paper are: 1. Define a new abstraction function based on variable clustering and define consistency on different levels of Pearl's causal hierarchy. 2. Propose how to use NCM for intervention and counterfactual reasoning when the real SCM is unavailable. 3. Introduce a variant of NCM that can learn representations and encode causal assumptions when relaxing the cluster assumption. 4. Verify the effectiveness of the theory through experiments and show how to extend causal reasoning to high - dimensional settings (such as image data). Through these methods, the paper provides new ideas and technical support for using causal abstraction in practical applications.

Neural Causal Abstractions

Causality in Neural Networks -- An Extended Abstract

The Causal-Neural Connection: Expressiveness, Learnability, and Inference

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations

Causal Deep Learning

Deep Causal Learning: Representation, Discovery and Inference

Learning Causal Abstractions of Linear Structural Causal Models

Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability

From Dependence to Causation

Toward Causal Representation Learning

Neural Causal Models for Counterfactual Identification and Estimation

Do learned representations respect causal relationships?

Explaining the Behavior of Black-Box Prediction Algorithms with Causal Learning

Amortized learning of neural causal representations

Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment

Causal-StoNet: Causal Inference for High-Dimensional Complex Data

Towards Learning and Explaining Indirect Causal Effects in Neural Networks

CausalKG: Causal Knowledge Graph Explainability using interventional and counterfactual reasoning

Enhancing the Performance of Neural Networks Through Causal Discovery and Integration of Domain Knowledge