Abstract:Prevalent in biological applications (e.g., human phenotype measurements), multimodal datasets can provide valuable insights into the underlying biological mechanisms. However, current machine learning models designed to analyze such datasets still lack interpretability and theoretical guarantees, which are essential to biological applications. Recent advances in causal representation learning have shown promise in uncovering the interpretable latent causal variables with formal theoretical certificates. Unfortunately, existing works for multimodal distributions either rely on restrictive parametric assumptions or provide rather coarse identification results, limiting their applicability to biological research which favors a detailed understanding of the mechanisms. In this work, we aim to develop flexible identification conditions for multimodal data and principled methods to facilitate the understanding of biological datasets. Theoretically, we consider a flexible nonparametric latent distribution (c.f., parametric assumptions in prior work) permitting causal relationships across potentially different modalities. We establish identifiability guarantees for each latent component, extending the subspace identification results from prior work. Our key theoretical ingredient is the structural sparsity of the causal connections among distinct modalities, which, as we will discuss, is natural for a large collection of biological systems. Empirically, we propose a practical framework to instantiate our theoretical insights. We demonstrate the effectiveness of our approach through extensive experiments on both numerical and synthetic datasets. Results on a real-world human phenotype dataset are consistent with established medical research, validating our theoretical and methodological framework.

Recognizing Human Group Behaviors with Multi-Group Causalities

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

CauSkelNet: Causal Representation Learning for Human Behaviour Analysis

Recognizing Cognitive Load by a Hybrid Spatio-Temporal Causal Model from Multivariate Physiological Data

Recognition of interactive human groups from mobile sensing data

Multi-label Causal Variable Discovery: Learning Common Causal Variables and Label-specific Causal Variables

Who Walks With You Matters: Perceiving Social Interactions with Groups for Pedestrian Trajectory Prediction

Deep Learning-based Group Causal Inference in Multivariate Time-series

Deep Causal Domain Generalization Network for Human Action Recognition in Internet of Behaviors

Research on Multi-Scale Spatio-Temporal Graph Convolutional Human Behavior Recognition Method Incorporating Multi-Granularity Features

Learning causal structures using hidden compact representation

Discriminative Latent Models for Recognizing Contextual Group Activities

Online Recognition of Group Actions in Intelligent Meeting Scenario

Video Sensor-Based Complex Scene Analysis with Granger Causality.

Causal Representation Learning from Multimodal Biological Observations

A Causal And-Or Graph Model for Visibility Fluent Reasoning in Tracking Interacting Objects

Causal Discovery of Dynamic Models for Predicting Human Spatial Interactions

Dcv: a Causality Detection Approach for Large-Scale Dynamic Collaboration Environments

CausalMob: Causal Human Mobility Prediction with LLMs-derived Human Intentions toward Public Events

Human Behavior Recognition for Substation Operation and Maintenance

A group behavior identification method and system based on CD motion features