Abstract:Confounders in deep learning are in general detrimental to model’s generalization where they infiltrate feature representations. Therefore, learning causal features that are free of interference from confounders is important. Most previous causal learning based approaches employ back-door criterion to mitigate the adverse effect of certain specific confounder, which require the explicit identification of confounder. However, in real scenarios, confounders are typically diverse and difficult to be identified. In this paper, we propose a novel Confounder Identification-free Causal Visual Feature Learning (CICF) method, which obviates the need for identifying confounders. CICF models the interventions among different samples based on front-door criterion, and then approximates the global-scope intervening effect upon the instance-level interventions from the perspective of optimization. In this way, we aim to find a reliable optimization direction, which avoids the intervening effects of confounders, to learn causal features. Furthermore, we uncover the relation between CICF and the popular meta-learning strategy MAML [9], and provide an interpretation of why MAML works from the theoretical perspective of causal learning for the first time. Thanks to the effective learning of causal features, our CICF enables models to have superior generalization capability. Extensive experiments on domain generalization benchmark datasets demonstrate the effectiveness of our CICF, which achieves the state-of-the-art performance.

Decoupled Visual Causality for Robust Detection

Contextual Debiasing for Visual Recognition with Causal Mechanisms

Causality Compensated Attention for Contextual Biased Visual Recognition

CausalPC: Improving the Robustness of Point Cloud Classification by Causal Effect Identification

Adversarial Visual Robustness by Causal Intervention

Disentangle and Remerge: Interventional Knowledge Distillation for Few-Shot Object Detection from a Conditional Causal Perspective

Confounder Identification-free Causal Visual Feature Learning

Multi-Cause Effect Estimation with Disentangled Confounder Representation

Causal deep learning for explainable vision-based quality inspection under visual interference

A Coutour Detection Model Based on Surround Inhibition with Multiple Cues.

Disentanglement of Latent Representations via Causal Interventions

Causal Interventional Training for Image Recognition

Interpreting Low-level Vision Models with Causal Effect Maps

Towards Causal Representation Learning and Deconfounding from Indefinite Data

Learning Causality-inspired Representation Consistency for Video Anomaly Detection

Towards Deconfounded Image-Text Matching with Causal Inference

Learning Perceptual Causality from Video

Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanisms

Deconfounded Image Captioning: A Causal Retrospect

CausalDiff: Causality-Inspired Disentanglement via Diffusion Model for Adversarial Defense

Causal reasoning in typical computer vision tasks