Abstract:The intelligent campus surveillance system is beneficial to improve safety in school. Abnormal behavior recognition, a field of action recognition in computer vision, plays an essential role in intelligent surveillance systems. Computer vision has been actively applied to action recognition systems based on Convolutional Neural Networks (CNNs). However, capturing sufficient motion sequence features from videos remains a significant challenge in action recognition. This work explores the challenges of video-based abnormal behavior recognition on campus. In addition, a novel framework is established on long-range temporal video structure modeling and a global sparse uniform sampling strategy that divides a video into three segments of identical durations and uniformly samples each snippet. The proposed method incorporates a consensus of three temporal segment transformers (TST) that globally connects patches and computes self-attention with joint spatiotemporal factorization. The proposed model is developed on the newly created campus abnormal behavior recognition (CABR50) dataset, which contains 50 human abnormal action classes with an average of over 700 clips per class. Experiments show that it is feasible to implement abnormal behavior recognition on campus and that the proposed method is competitive with other peer video recognition in terms of Top-1 and Top-5 recognition accuracy. The results suggest that TST-L+ can improve campus abnormal behavior recognition, corresponding to Top-1 and Top-5 accuracy results of 83.57% and 97.16%, respectively.

Skeleton Based Abnormal Behavior Recognition Using Spatio-Temporal Convolution and Attention-Based LSTM

A study on attention-based LSTM for abnormal behavior recognition with variable pooling

Video Abnormal Behavior Recognition and Trajectory Prediction Based on Lightweight Skeleton Feature Extraction

Abnormal behavior recognition using 3D-CNN combined with LSTM

Worker Abnormal Behavior Recognition Based on Spatio-Temporal Graph Convolution and Attention Model

A Skeleton-based Action Recognition System for Medical Condition Detection

Deep Learning Methods for Human Behavior Recognition.

A New Method of Abnormal Behavior Detection Using LSTM Network with Temporal Attention Mechanism

Human Behavior Recognition Based on Attention Mechanism and Bottleneck Residual Dual-Path Spatiotemporal Graph Convolutional Network

Graph-Temporal LSTM Networks for Skeleton-Based Action Recognition

Research on Multi-Scale Spatio-Temporal Graph Convolutional Human Behavior Recognition Method Incorporating Multi-Granularity Features

Research on Character Behavior Recognition Based on Local Spatio-temporal Relationship in Surveillance Video

An Abnormal Behavior Recognition Method Based on Fusion Features

Exploring a Rich Spatial-Temporal Dependent Relational Model for Skeleton-Based Action Recognition by Bidirectional LSTM-CNN.

Campus Abnormal Behavior Recognition With Temporal Segment Transformers

Skeleton-based Action Recognition Using LSTM and CNN

Abnormal Behavior Recognition Based on 3D Dense Connections

Skeleton-Based Pedestrian Abnormal Behavior Detection with Spatio-Temporal Model in Public Places

Abnormal Behavior Recognition Based on Skeleton Key Points

Hierarchical Graph Embedded Pose Regularity Learning via Spatio-Temporal Transformer for Abnormal Behavior Detection

Research into the Applications of a Multi-Scale Feature Fusion Model in the Recognition of Abnormal Human Behavior