Abstract:The key problem in human behavior recognition is how to build a spatiotemporal feature extraction and classification network. Aiming at the problem that the existing channel attention mechanism directly pools the global average information of each channel and ignores its local spatial information, this paper proposes two improved channel attention modules, namely the space-time (ST) interaction module of matrix operation and the depth separable convolution module, combined with the research of human behavior recognition. Combined with the superior performance of convolutional neural network (CNN) in image and video processing, a multi-scale convolutional neural network method for human behavior recognition is proposed. Firstly, the behavior video is segmented, and low rank learning is performed on each video segment to extract the corresponding Low rank behavior information, and then these Low rank behavior information are connected on the time axis to obtain the Low rank behavior information of the whole video, so as to effectively capture the behavior information in the video, avoiding tedious extraction steps and various assumptions. The ability of neural network to model human behavior can be transferred and reused in networks with different structures. According to the different characteristics of data features at different network levels, two effective feature difference measurement functions are introduced to reduce the difference between features extracted from different network structures. Experiments on several public datasets show that the proposed method has a good classification effect. The experimental results show that the method has a good accuracy in human behavior recognition. It is proved that the proposed model not only improves the recognition accuracy, but also effectively reduces the computational complexity of output weights and improves the compactness of the model structure.

Group behavior recognition model based on progressive relationship learning and training method thereof

Spatio-Temporal Dynamic Inference Network for Group Activity Recognition

Progressive Relation Learning for Group Activity Recognition

Hierarchical Gate Network for Fine-Grained Visual Recognition.

Relational graph neural network for situation recognition

Multi-layer Graph Convolution Neural Network for Human Behavior Recognition Incorporating Spatial Attention

Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition

Time-aware multi-behavior graph network model for complex group behavior prediction

Grouping Attribute Recognition for Pedestrian with Joint Recurrent Learning

Deep Learning Methods for Human Behavior Recognition.

Mining Semantics-Preserving Attention for Group Activity Recognition.

Research on Multi-Scale Spatio-Temporal Graph Convolutional Human Behavior Recognition Method Incorporating Multi-Granularity Features

Multi-view and multi-scale behavior recognition algorithm based on attention mechanism

Student Behavior Recognition From Heterogeneous View Perception in Class Based on 3-D Multiscale Residual Dense Network for the Analysis of Case Teaching

From Facial Expression Recognition to Interpersonal Relation Prediction

A Multimodal Behavior Recognition Network with Interconnected Architectures

Multiuser Behavior Recognition Module Based on DC-DMN

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

A 4D strong spatio-temporal feature learning network for behavior recognition of point cloud sequences

Behavior Recognition Algorithm Based on the Fusion of SE-R3D and LSTM Network

Multivariate Relations Aggregation Learning in Social Networks