Abstract:In this paper, we develop a generic methodology to encode hierarchical causality structure among observed variables into a neural network in order to improve its predictive performance. The proposed methodology, called causality-informed neural network (CINN), leverages three coherent steps to systematically map the structural causal knowledge into the layer-to-layer design of neural network while strictly preserving the orientation of every causal relationship. In the first step, CINN discovers causal relationships from observational data via directed acyclic graph (DAG) learning, where causal discovery is recast as a continuous optimization problem to avoid the combinatorial nature. In the second step, the discovered hierarchical causality structure among observed variables is systematically encoded into neural network through a dedicated architecture and customized loss function. By categorizing variables in the causal DAG as root, intermediate, and leaf nodes, the hierarchical causal DAG is translated into CINN with a one-to-one correspondence between nodes in the causal DAG and units in the CINN while maintaining the relative order among these nodes. Regarding the loss function, both intermediate and leaf nodes in the DAG graph are treated as target outputs during CINN training so as to drive co-learning of causal relationships among different types of nodes. As multiple loss components emerge in CINN, we leverage the projection of conflicting gradients to mitigate gradient interference among the multiple learning tasks. Computational experiments across a broad spectrum of UCI data sets demonstrate substantial advantages of CINN in predictive performance over other state-of-the-art methods. In addition, an ablation study underscores the value of integrating structural and quantitative causal knowledge in enhancing the neural network's predictive performance incrementally.

Neural Information Squeezer for Causal Emergence

Finding emergence in data by maximizing effective information

An Exact Theory of Causal Emergence for Linear Stochastic Iteration Systems

Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

The Cause of Causal Emergence: Redistribution of Uncertainty

Emergence and Causality in Complex Systems: A Survey of Causal Emergence and Related Quantitative Studies

Cause of Causal Emergence: Redistribution of Uncertainty and Its Critical Condition

Causal Attention to Exploit Transient Emergence of Causal Effect

Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studies

Neural Causal Information Extractor for Unobserved Causes

Dynamical Reversibility and A New Theory of Causal Emergence

Multi-granularity Causal Structure Learning

The Causal-Neural Connection: Expressiveness, Learnability, and Inference

Entropic Causal Inference for Neurological Applications

Causality is all you need

Neural Causal Abstractions

On Learning Necessary and Sufficient Causal Graphs

Enhancing the Performance of Neural Networks Through Causal Discovery and Integration of Domain Knowledge

CUTS: Neural Causal Discovery from Irregular Time-Series Data

Emerging Intelligent Computing Technology and Applications

CUTS: Neural Causal Discovery from Unstructured Time-Series Data