Abstract:Complex activities typically consist of multiple primitive events happening in parallel or sequentially over a period of time. Understanding such activities requires recognizing not only each individual event but, more importantly, capturing their spatiotemporal dependencies over different time intervals. Most of the current graphical model-based approaches have several limitations. First, time--sliced graphical models such as hidden Markov models (HMMs) and dynamic Bayesian networks are typically based on points of time and they hence can only capture three temporal relations: precedes, follows, and equals. Second, HMMs are probabilistic finite-state machines that grow exponentially as the number of parallel events increases. Third, other approaches such as syntactic and description-based methods, while rich in modeling temporal relationships, do not have the expressive power to capture uncertainties. To address these issues, we introduce the interval temporal Bayesian network (ITBN), a novel graphical model that combines the Bayesian Network with the interval algebra to explicitly model the temporal dependencies over time intervals. Advanced machine learning methods are introduced to learn the ITBN model structure and parameters. Experimental results show that by reasoning with spatiotemporal dependencies, the proposed model leads to a significantly improved performance when modeling and recognizing complex activities involving both parallel and sequential events.

Composite behavior analysis for video surveillance using hierarchical dynamic Bayesian networks

Recognizing Interaction Activities using Dynamic Bayesian Network

Activity recognition through multi-scale dynamic Bayesian network

Human Behavior Recognition Based on Attention Mechanism and Bottleneck Residual Dual-Path Spatiotemporal Graph Convolutional Network

Interacting activity recognition using hierarchical durational-state dynamic bayesian network

Human Interaction Representation and Recognition Through Motion Decomposition.

Robust Complex Behaviour Modeling at 90Hz.

Analyzing multiple types of behaviors from traffic videos via nonparametric topic model

A Bayesian computer vision system for modeling human interactions

Activity recognition through multi-scale motion detail analysis.

Posture based health monitoring and unusual behavior recognition system for elderly using dynamic Bayesian network

Human action recognition using a dynamic Bayesian action network with 2D part models

Joint Motion Information Extraction and Human Behavior Recognition in Video Based on Deep Learning

Dynamic Graph Modules for Modeling Object-Object Interactions in Activity Recognition

Modeling temporal interactions with interval temporal bayesian networks for complex activity recognition

Dynamic Human Behavior Pattern Detection and Classification

A Hierarchical Model of Shape and Appearance for Human Action Classification

Human Behavior Recognition from Multiview Videos

Research on Character Behavior Recognition Based on Local Spatio-temporal Relationship in Surveillance Video

Human Behavior Recognition of Video Surveillance System Based on Neural Network

HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action Recognition