Abstract:Collective activity recognition, which tells what activity a group of people is performing, is a cutting-edge research topic in computer vision. Different from action performed by individuals, collective activity needs to consider the complex interactions among different people. However, most previous works require exhaustive annotations such as accurate label information of individual actions, pairwise interactions, and poses, which could not be easily available in practice. Moreover, most of them treat human detection as a decoupled task before collective activity recognition and leverage all detected persons. This not only ignores the mutual relation between the two tasks, which makes it hard for filtering out irrelevant people, but also probably increases the computation burden when reasoning the collective activities. In this paper, we propose a fast weakly supervised deep learning architecture for collective activity recognition. For fast inference, we propose to make the actor detection and weakly supervised collective activity reasoning collaborate in an end-toend framework by sharing convolutional layers between them. The joint learning makes the two tasks united and reinforced each other, so that it is more effective to filter out the outliers who are not involved in the activity. For the weakly supervised learning, we propose a latent embedding scheme for mining person-group interactive relationship to get rid of the use of any pairwise relation between people and the individual action labels as well. The experimental results show that the proposed framework achieves comparable or even better performance as compared to the state-of-the-art on three datasets. Our joint modelling reasons collective activities at the speed of 22.65 fps, which is the fastest ever known and substantially makes collective activity recognition more towards real-time applications.

A Progressive Hierarchical Analysis Model for Collective Activity Recognition

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Hierarchical Attention and Context Modeling for Group Activity Recognition.

Online Robust Action Recognition Based on a Hierarchical Model

Hierarchical Deep Temporal Models for Group Activity Recognition

Spatio-Temporal Triangular-Chain Crf For Activity Recognition

Fast Collective Activity Recognition Under Weak Supervision

Learning Person-Person Interaction in Collective Activity Recognition.

Active Spatial Positions Based Hierarchical Relation Inference for Group Activity Recognition

Progressive Relation Learning for Group Activity Recognition

A Hierarchical Spatio-Temporal Model for Human Activity Recognition.

Hierarchical group process representation in multi-agent activity recognition

Latent Embeddings for Collective Activity Recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Discovery and Recognition of Emerging Human Activities Using a Hierarchical Mixture of Directional Statistical Models.

Recurrent Modeling Of Interaction Context For Collective Activity Recognition

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Hierarchical Activity Recognition Using Smart Watches and RGB-Depth Cameras.

Learning Dynamic Spatio-Temporal Relations for Human Activity Recognition.

Learning Action Correlation and Temporal Aggregation for Group Representation

Participation-Contributed Temporal Dynamic Model for Group Activity Recognition.