Abstract:Most mainstream statistical models will achieve poor performance in Out-Of-Distribution (OOD) generalization. This is because these models tend to learn the spurious correlation between data and will collapse when the domain shift exists. If we want artificial intelligence (AI) to make great strides in real life, the current focus needs to be shifted to the OOD problem of deep learning models to explore the generalization ability under unknown environments. Domain generalization (DG) focusing on OOD generalization is proposed, which is able to transfer the knowledge extracted from multiple source domains to the unseen target domain. We are inspired by intuitive thinking about human intelligence relying on causality. Unlike relying on plain probability correlations, we apply a novel causal perspective to DG, which can improve the OOD generalization ability of the trained model by mining the invariant causal mechanism. Firstly, we construct the inclusive causal graph for most DG tasks through stepwise causal analysis based on the data generation process in the natural environment and introduce the reasonable Structural Causal Model (SCM). Secondly, based on counterfactual inference, causal semantic representation learning with domain intervention (CSRDN) is proposed to train a robust model. In this regard, we generate counterfactual representations for different domain interventions, which can help the model learn causal semantics and develop generalization capacity. At the same time, we seek the Pareto optimal solution in the optimization process based on the loss function to obtain a more advanced training model. Extensive experimental results of Rotated MNIST and PACS as well as VLCS datasets verify the effectiveness of the proposed CSRDN. The proposed method can integrate causal inference into domain generalization by enhancing interpretability and applicability and brings a boost to challenging OOD generalization problems.

DICE: Domain-attack Invariant Causal Learning for Improved Data Privacy Protection and Adversarial Robustness

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

D-DAE: Defense-Penetrating Model Extraction Attacks.

Adversarial for Good – Defending Training Data Privacy with Adversarial Attack Wisdom

A GAN-Based Defense Framework Against Model Inversion Attacks.

Privacy-preserving Universal Adversarial Defense for Black-box Models

CausalDiff: Causality-Inspired Disentanglement via Diffusion Model for Adversarial Defense

Alleviating Privacy Attacks via Causal Learning

Backdoor Defense Via Deconfounded Representation Learning

CausalPC: Improving the Robustness of Point Cloud Classification by Causal Effect Identification

From Attack to Defense: Insights into Deep Learning Security Measures in Black-Box Settings

CALoR: Towards Comprehensive Model Inversion Defense

Demonstration Attack against In-Context Learning for Code Intelligence

Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses

Intrusion detection framework based on causal reasoning for DDoS

Where and How to Attack? A Causality-Inspired Recipe for Generating Counterfactual Adversarial Examples

Certified Causal Defense with Generalizable Robustness

Inspecting Prediction Confidence for Detecting Black-Box Backdoor Attacks

A Causality-Aware Perspective on Domain Generalization via Domain Intervention

Adversarial Attacks Against Deep Learning-Based Network Intrusion Detection Systems and Defense Mechanisms

Certified Robustness Against Natural Language Attacks by Causal Intervention