Abstract:The violence in public areas occurs frequently and video surveillance is of great significance for maintaining public safety.Compared with fixed cameras,unmanned aerial vehicles (UAVs) have surveillance mobility.However,in aerial images,the rapid movement of UAVs as well as the change of posture and height cause the problem of motion blur and large-scale change of target.To solve this problem,an attention spatial-temporal convolutional network (AST-GCN) combining attention mechanism is designed to realize the identification of violent behavior in aerial video.The proposed method is divided into two steps:the key frame detection network completes the initial positioning,and the AST-GCN network completes the behavior identification through the sequence features.Firstly,aiming at video violence localization,a key frame cascade detection network is designed to realize violence key frame detection based on human posture estimation,and preliminarily judge the occurrence time of violence.Secondly,the skeleton information of multiple frames around key frames is extracted from the video sequence,and the skeleton data is pre-processed,including normalization,screening and completion,so as to improve the robustness of different scenes and the partial missing of key nodes.And the skeleton temporal-spatial representation matrix is constructed according to the extracted skeleton information.Finally,AST-GCN network analyzes and identifies multiple frames of human skeleton information,to integrate attention module,improve feature expression ability,and complete the recognition of violent behavior.The method is validated on self-built aerial violence data set,and experimental results show that the AST-GCN can realize the recognition of aerial scene violence,and the recognition accuracy is 86.6%.The proposed method has important engineering value and scientific signifi-cance for the realization of aerial video surveillance and human pose understanding applications.

A Framework for Knowing Who is Doing What in Aerial Surveillance Videos.

AZTR: Aerial Video Action Recognition with Auto Zoom and Temporal Reasoning

A Study on Action Detection in the Wild

A Multi-Person Video Dataset Annotation Method of Spatio-Temporally Actions

Action Recognition by Exploring Data Distribution and Feature Correlation

Joint inference of groups, events and human roles in aerial videos

A Structured Model For Action Detection

A novel approach for enhanced abnormal action recognition via coarse and precise detection stage

An Application-Agnostic Automatic Target Recognition System Using Vision Language Models

JARViS: Detecting Actions in Video Using Unified Actor-Scene Context Relation Modeling

Action recognition using attention-based spatio-temporal VLAD networks and adaptive video sequences optimization

MITFAS: Mutual Information based Temporal Feature Alignment and Sampling for Aerial Video Action Recognition

Learning Spatial and Temporal Extents of Human Actions for Action Detection

Action-Stage Emphasized Spatiotemporal VLAD for Video Action Recognition

Action Recognition by Hierarchical Mid-level Action Elements

Aerial Violence Recognition Based on Spatial-Temporal Graph Convolutional Networks and Attention Model

YOWOv2: A Stronger yet Efficient Multi-level Detection Framework for Real-time Spatio-temporal Action Detection

Human Action Recognition Based on Action Relevance Weighted Encoding

Action Recognition Using Spatial-Optical Data Organization and Sequential Learning Framework

View-invariant Action Recognition in Surveillance Videos

Analysis of Human Actions for Video Indexing