Abstract:Most mainstream statistical models will achieve poor performance in Out-Of-Distribution (OOD) generalization. This is because these models tend to learn the spurious correlation between data and will collapse when the domain shift exists. If we want artificial intelligence (AI) to make great strides in real life, the current focus needs to be shifted to the OOD problem of deep learning models to explore the generalization ability under unknown environments. Domain generalization (DG) focusing on OOD generalization is proposed, which is able to transfer the knowledge extracted from multiple source domains to the unseen target domain. We are inspired by intuitive thinking about human intelligence relying on causality. Unlike relying on plain probability correlations, we apply a novel causal perspective to DG, which can improve the OOD generalization ability of the trained model by mining the invariant causal mechanism. Firstly, we construct the inclusive causal graph for most DG tasks through stepwise causal analysis based on the data generation process in the natural environment and introduce the reasonable Structural Causal Model (SCM). Secondly, based on counterfactual inference, causal semantic representation learning with domain intervention (CSRDN) is proposed to train a robust model. In this regard, we generate counterfactual representations for different domain interventions, which can help the model learn causal semantics and develop generalization capacity. At the same time, we seek the Pareto optimal solution in the optimization process based on the loss function to obtain a more advanced training model. Extensive experimental results of Rotated MNIST and PACS as well as VLCS datasets verify the effectiveness of the proposed CSRDN. The proposed method can integrate causal inference into domain generalization by enhancing interpretability and applicability and brings a boost to challenging OOD generalization problems.

Deep Causal Domain Generalization Network for Human Action Recognition in Internet of Behaviors

Human Action Recognition Using Deep Learning Methods.

CauSkelNet: Causal Representation Learning for Human Behaviour Analysis

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Learning Causal Representation for Training Cross-Domain Pose Estimator Via Generative Interventions

Deep Attention Network for Egocentric Action Recognition.

Background no more: Action recognition across domains by causal interventions

DIGIC: Domain Generalizable Imitation Learning by Causal Discovery

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

A Causality-Aware Perspective on Domain Generalization via Domain Intervention

Online Robust Action Recognition Based on a Hierarchical Model

CDFi: Cross-Domain Action Recognition using WiFi Signals

Human-Centric Transformer for Domain Adaptive Action Recognition

Deep Learning-Based Human Action Recognition in Videos

DWnet: Deep-Wide Network for 3D Action Recognition

Dense Semantics-Assisted Networks For Video Action Recognition

Causality Inspired Representation Learning for Domain Generalization

Dynamic Probabilistic Network Based Human Action Recognition

Multi-Stream Deep Neural Networks for RGB-D Egocentric Action Recognition

Deep Neural Networks in Video Human Action Recognition: A Review