Abstract:Group activity recognition aims to recognize holistic activity in multi-person scene, necessitating consideration of the interactions between actors and their surroundings. It has various applications, such as public surveillance, video analysis. Nonetheless, existing works merely extract scene features as a supplementary component of activity features, failing to adequately explore the interplay between the scene and actors. To address this limitation, this paper proposes a Local–Global Context-Aware Graph Reasoning Model (LG-CAGR), which leverages and reasons through local and global context features to gain deeper insights into group activity within the scene. In particular, we present an innovative feature extraction strategy to harness local location features and global scene attributes, effectively complementing actor features by capturing spatial group topology and determining relative positions between actors. Subsequently, we delve into these features by devising a local–global group reasoning module that deduces pair-wise interactions between actors and scenes within Graph Convolutional Network, comprehensively elucidating correlations between overall scene and local individuals to construct group-level features. Multi-graphs are constructed considering actor's features, scene features as nodes, and interactions as edges. A self-attention graph pooling network is introduced to automatically integrate key actor features and form rich group-level features to recognize group activity. The results on Collective Activity Dataset, Collective Activity Extended Dataset, Volleyball Dataset and Public Life in Public Space dataset have reached 94.0%, 97.7%, 92.7% and 56.1%. Compared with existing methods using the same backbone, we exceeded 1%, 2.1%, 0.3%, and 14.9% respectively, affirming the superiority of the proposed method compared with state-of-the-art methods.

Explained Activity Recognition with Computational Assumption-Based Argumentation

A First Step Towards Explained Activity Recognition With Computational Abstract Argumentation

Learning Visual Context for Group Activity Recognition.

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Explainable Activity Recognition for Smart Home Systems

Semantics-Driven Multi-user Concurrent Activity Recognition.

Exploring Semantics in Activity Recognition Using Context Lattices.

Two Forms of Explanations in Computational Assumption-based Argumentation

A Scalable Approach to Activity Recognition based on Object Use

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Explainable Deep Learning Framework for Human Activity Recognition

Context-Associative Hierarchical Memory Model for Human Activity Recognition and Prediction

Meta-Activity Recognition: A Wearable Approach For Logic Cognition-Based Activity Sensing

Unveiling group activity recognition: Leveraging Local–Global Context-Aware Graph Reasoning for enhanced actor–scene interactions

Leveraging Cognitive Context Knowledge for Argumentation-Based Object Classification in Multi-Sensor Networks

Multi-User Activity Recognition In A Smart Home

Dynamic Inference via Localizing Semantic Intervals in Sensor Data for Budget-Tunable Activity Recognition

Context-Aware Layered Learning for Argumentation Based Multiagent Collaborative Recognition

Location-Free Csi Based Activity Recognition With Angle Difference Of Arrival

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Mining Intricate Temporal Rules for Recognizing Complex Activities of Daily Living under Uncertainty.