Abstract:In this paper, we go beyond recognizing the actions of individuals and focus on group activities. This is motivated from the observation that human actions are rarely performed in isolation; the contextual information of what other people in the scene are doing provides a useful cue for understanding high-level activities. We propose a novel framework for recognizing group activities which jointly captures the group activity, the individual person actions, and the interactions among them. Two types of contextual information, group-person interaction and person-person interaction, are explored in a latent variable framework. In particular, we propose three different approaches to model the person-person interaction. One approach is to explore the structures of person-person interaction. Differently from most of the previous latent structured models, which assume a predefined structure for the hidden layer, e.g., a tree structure, we treat the structure of the hidden layer as a latent variable and implicitly infer it during learning and inference. The second approach explores person-person interaction in the feature level. We introduce a new feature representation called the action context (AC) descriptor. The AC descriptor encodes information about not only the action of an individual person in the video, but also the behavior of other people nearby. The third approach combines the above two. Our experimental results demonstrate the benefit of using contextual information for disambiguating group activities.

Sparse Bayesian discriminative learning method for context-based scene recognition model

Dictionary Learning Inspired Deep Network for Scene Recognition

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Sparse Coding of Visual Context

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Context Exploitation using Hierarchical Bayesian Models

Learning Coarse-To-Fine Sparselets For Efficient Object Detection And Scene Classification

Discriminative Latent Models for Recognizing Contextual Group Activities

Collaborative Representation Bayesian Face Recognition

Context-Based Contrastive Learning for Scene Text Recognition

Scene categorization via supervised subspace modeling and sparse representation

Reconfigurable models for scene recognition

Behavior recognition based on the improved density clustering and context-guided Bi-LSTM model

Cross Scene Prediction via Modeling Dynamic Correlation using Latent Space Shared Auto-Encoders

Scene understanding with discriminative structured prediction

Context-Aware Sparse Decomposition for Image Denoising and Super-Resolution

Robust local metric learning via least square regression regularization for scene recognition

A Novel Context-Aware Topic Model For Category Discovery In Natural Scenes

Revisiting Sparse Convolutional Model for Visual Recognition

Learning a Scene Contextual Model for Tracking and Abnormality Detection