Abstract:By adhering to the dictum, "No causation without manipulation (treatment, intervention)", cause and effect data analysis represents changes in observed data in terms of changes in the causal factors. When causal factors are not amenable for active manipulation in the real world due to current technological limitations or ethical considerations, a counterfactual approach performs an intervention on the model of data formation. In the case of object representation or activity (temporal object) representation, varying object parts is generally unfeasible whether they be spatial and/or temporal. Multilinear algebra, the algebra of higher-order tensors, is a suitable and transparent framework for disentangling the causal factors of data formation. Learning a part-based intrinsic causal factor representations in a multilinear framework requires applying a set of interventions on a part-based multilinear model. We propose a unified multilinear model of wholes and parts. We derive a hierarchical block multilinear factorization, the M-mode Block SVD, that computes a disentangled representation of the causal factors by optimizing simultaneously across the entire object hierarchy. Given computational efficiency considerations, we introduce an incremental bottom-up computational alternative, the Incremental M-mode Block SVD, that employs the lower-level abstractions, the part representations, to represent the higher level of abstractions, the parent wholes. This incremental computational approach may also be employed to update the causal model parameters when data becomes available incrementally. The resulting object representation is an interpretable combinatorial choice of intrinsic causal factor representations related to an object's recursive hierarchy of wholes and parts that renders object recognition robust to occlusion and reduces training data requirements.

Compositional Hierarchical Tensor Factorization: Representing Hierarchical Intrinsic and Extrinsic Causal Factors

Deep Tensor Factorization for Hyperspectral Image Classification.

CausalX: Causal Explanations and Block Multilinear Factor Analysis

Nested Fully-Connected Tensor Network Decomposition for Multi-Dimensional Visual Data Recovery

Hierarchical compositional feature learning

Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networks

Reassessing Hierarchical Representation for Action Recognition in Still Images

Tied Factors Analysis for High-Dimensional Image Feature Extraction and Recognition Application

Learning to Infer Unseen Attribute-Object Compositions

Learning Unseen Concepts Via Hierarchical Decomposition and Composition

Towards a Unified Compositional Model for Visual Pattern Modeling

Hierarchical Tensor Approximation of Multi-Dimensional Visual Data

A hierarchical compositional model for face representation and sketching.

A causal view of compositional zero-shot recognition

Compositional scene modeling with global object-centric representations

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

Triple Component Matrix Factorization: Untangling Global, Local, and Noisy Components

NeuLFT: A Novel Approach to Nonlinear Canonical Polyadic Decomposition on High-Dimensional Incomplete Tensors

Compositional Convolutional Neural Networks: A Deep Architecture with Innate Robustness to Partial Occlusion

Hierarchical Visual Primitive Experts for Compositional Zero-Shot Learning

Hyperspectral Super-Resolution: A Coupled Nonnegative Block-Term Tensor Decomposition Approach