Abstract:Group activity recognition aims to recognize holistic activity in multi-person scene, necessitating consideration of the interactions between actors and their surroundings. It has various applications, such as public surveillance, video analysis. Nonetheless, existing works merely extract scene features as a supplementary component of activity features, failing to adequately explore the interplay between the scene and actors. To address this limitation, this paper proposes a Local–Global Context-Aware Graph Reasoning Model (LG-CAGR), which leverages and reasons through local and global context features to gain deeper insights into group activity within the scene. In particular, we present an innovative feature extraction strategy to harness local location features and global scene attributes, effectively complementing actor features by capturing spatial group topology and determining relative positions between actors. Subsequently, we delve into these features by devising a local–global group reasoning module that deduces pair-wise interactions between actors and scenes within Graph Convolutional Network, comprehensively elucidating correlations between overall scene and local individuals to construct group-level features. Multi-graphs are constructed considering actor's features, scene features as nodes, and interactions as edges. A self-attention graph pooling network is introduced to automatically integrate key actor features and form rich group-level features to recognize group activity. The results on Collective Activity Dataset, Collective Activity Extended Dataset, Volleyball Dataset and Public Life in Public Space dataset have reached 94.0%, 97.7%, 92.7% and 56.1%. Compared with existing methods using the same backbone, we exceeded 1%, 2.1%, 0.3%, and 14.9% respectively, affirming the superiority of the proposed method compared with state-of-the-art methods.

A comprehensive review of deep learning approaches for group activity analysis

Group Activity Recognition in Computer Vision: A Comprehensive Review, Challenges, and Future Perspectives

A Review of Deep Learning Techniques for Crowd Behavior Analysis

A Review of Deep Learning Techniques for Crowd Management

Approaches on crowd counting and density estimation: a review

Crowd Characterization in Surveillance Videos Using Deep-Graph Convolutional Neural Network

Deep Learning for Sensor-based Activity Recognition: A Survey

Deep Structured Models For Group Activity Recognition

Human crowd behaviour analysis based on video segmentation and classification using expectation–maximization with deep learning architectures

Deep Learning Approaches for Crowd Density Estimation: A Review

A recent survey for human activity recoginition based on deep learning approach

Understanding and Improving Deep Neural Network for Activity Recognition

Visual Crowd Analysis: Open Research Problems

Collaboration Analysis Using Deep Learning

Revisiting Crowd Counting: State-of-the-art, Trends, and Future Perspectives

DGG: A Novel Framework for Crowd Gathering Detection

A Comprehensive Review of Community Detection in Graphs

Unveiling group activity recognition: Leveraging Local–Global Context-Aware Graph Reasoning for enhanced actor–scene interactions

Collective Intelligence for Deep Learning: A Survey of Recent Developments

A Survey on Deep Learning-based Single Image Crowd Counting: Network Design, Loss Function and Supervisory Signal

Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities