Abstract:Group activity recognition aims to recognize holistic activity in multi-person scene, necessitating consideration of the interactions between actors and their surroundings. It has various applications, such as public surveillance, video analysis. Nonetheless, existing works merely extract scene features as a supplementary component of activity features, failing to adequately explore the interplay between the scene and actors. To address this limitation, this paper proposes a Local–Global Context-Aware Graph Reasoning Model (LG-CAGR), which leverages and reasons through local and global context features to gain deeper insights into group activity within the scene. In particular, we present an innovative feature extraction strategy to harness local location features and global scene attributes, effectively complementing actor features by capturing spatial group topology and determining relative positions between actors. Subsequently, we delve into these features by devising a local–global group reasoning module that deduces pair-wise interactions between actors and scenes within Graph Convolutional Network, comprehensively elucidating correlations between overall scene and local individuals to construct group-level features. Multi-graphs are constructed considering actor's features, scene features as nodes, and interactions as edges. A self-attention graph pooling network is introduced to automatically integrate key actor features and form rich group-level features to recognize group activity. The results on Collective Activity Dataset, Collective Activity Extended Dataset, Volleyball Dataset and Public Life in Public Space dataset have reached 94.0%, 97.7%, 92.7% and 56.1%. Compared with existing methods using the same backbone, we exceeded 1%, 2.1%, 0.3%, and 14.9% respectively, affirming the superiority of the proposed method compared with state-of-the-art methods.

Stagnet: An Attentive Semantic Rnn For Group Activity Recognition

Stagnet: an Attentive Semantic RNN for Group Activity and Individual Action Recognition

Learning Visual Context for Group Activity Recognition.

A Channel-Wise Spatial-Temporal Aggregation Network for Action Recognition

Self-Supervised Global Spatio-Temporal Interaction Pre-Training for Group Activity Recognition.

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Group Activity Recognition Based on Temporal Semantic Sub-Graph Network.

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

Hierarchical Attention and Context Modeling for Group Activity Recognition.

Mining Semantics-Preserving Attention for Group Activity Recognition.

StNet: Local and Global Spatial-Temporal Modeling for Action Recognition

Learning Action Correlation and Temporal Aggregation for Group Representation

SSTA-Net: Self-supervised Spatio-Temporal Attention Network for Action Recognition.

CERN: Confidence-Energy Recurrent Network for Group Activity Recognition

Unveiling group activity recognition: Leveraging Local–Global Context-Aware Graph Reasoning for enhanced actor–scene interactions

Unified Spatio-Temporal Attention Networks for Action Recognition in Videos.

Spatiotemporal Information Complementary Modeling and Group Relationship Reasoning for Group Activity Recognition

Coarse-Fine Nested Network for Weakly Supervised Group Activity Recognition

Spatio-Temporal Attention Networks for Action Recognition and Detection

Spatio-Temporal driven Attention Graph Neural Network with Block Adjacency matrix (STAG-NN-BA)