Abstract:Group activity recognition aims to recognize holistic activity in multi-person scene, necessitating consideration of the interactions between actors and their surroundings. It has various applications, such as public surveillance, video analysis. Nonetheless, existing works merely extract scene features as a supplementary component of activity features, failing to adequately explore the interplay between the scene and actors. To address this limitation, this paper proposes a Local–Global Context-Aware Graph Reasoning Model (LG-CAGR), which leverages and reasons through local and global context features to gain deeper insights into group activity within the scene. In particular, we present an innovative feature extraction strategy to harness local location features and global scene attributes, effectively complementing actor features by capturing spatial group topology and determining relative positions between actors. Subsequently, we delve into these features by devising a local–global group reasoning module that deduces pair-wise interactions between actors and scenes within Graph Convolutional Network, comprehensively elucidating correlations between overall scene and local individuals to construct group-level features. Multi-graphs are constructed considering actor's features, scene features as nodes, and interactions as edges. A self-attention graph pooling network is introduced to automatically integrate key actor features and form rich group-level features to recognize group activity. The results on Collective Activity Dataset, Collective Activity Extended Dataset, Volleyball Dataset and Public Life in Public Space dataset have reached 94.0%, 97.7%, 92.7% and 56.1%. Compared with existing methods using the same backbone, we exceeded 1%, 2.1%, 0.3%, and 14.9% respectively, affirming the superiority of the proposed method compared with state-of-the-art methods.

Dynamical Attention Hypergraph Convolutional Network for Group Activity Recognition

Spatio-Temporal Dynamic Inference Network for Group Activity Recognition

Learning Visual Context for Group Activity Recognition.

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

HiGCIN: Hierarchical Graph-Based Cross Inference Network for Group Activity Recognition

Augmented skeleton sequences with hypergraph network for self-supervised group activity recognition

Multi-dimensional convolution transformer for group activity recognition

Social Adaptive Module for Weakly-supervised Group Activity Recognition

Position-Aware Participation-Contributed Temporal Dynamic Model for Group Activity Recognition.

Coarse-Fine Nested Network for Weakly Supervised Group Activity Recognition

LiGAR: LiDAR-Guided Hierarchical Transformer for Multi-Modal Group Activity Recognition

REACT: Recognize Every Action Everywhere All At Once

Unveiling group activity recognition: Leveraging Local–Global Context-Aware Graph Reasoning for enhanced actor–scene interactions

Improved Actor Relation Graph based Group Activity Recognition

Deep Structured Models For Group Activity Recognition

DECOMPL: Decompositional Learning with Attention Pooling for Group Activity Recognition from a Single Volleyball Image

MLP-AIR: An Efficient MLP-Based Method for Actor Interaction Relation Learning in Group Activity Recognition

Skeleton-based Group Activity Recognition via Spatial-Temporal Panoramic Graph

GAR-Net: A Graph Attention Reasoning Network for conversation understanding

SoGAR: Self-supervised Spatiotemporal Attention-based Social Group Activity Recognition

A hybrid attention-guided ConvNeXt-GRU network for action recognition