Abstract:The key problem in human behavior recognition is how to build a spatiotemporal feature extraction and classification network. Aiming at the problem that the existing channel attention mechanism directly pools the global average information of each channel and ignores its local spatial information, this paper proposes two improved channel attention modules, namely the space-time (ST) interaction module of matrix operation and the depth separable convolution module, combined with the research of human behavior recognition. Combined with the superior performance of convolutional neural network (CNN) in image and video processing, a multi-scale convolutional neural network method for human behavior recognition is proposed. Firstly, the behavior video is segmented, and low rank learning is performed on each video segment to extract the corresponding Low rank behavior information, and then these Low rank behavior information are connected on the time axis to obtain the Low rank behavior information of the whole video, so as to effectively capture the behavior information in the video, avoiding tedious extraction steps and various assumptions. The ability of neural network to model human behavior can be transferred and reused in networks with different structures. According to the different characteristics of data features at different network levels, two effective feature difference measurement functions are introduced to reduce the difference between features extracted from different network structures. Experiments on several public datasets show that the proposed method has a good classification effect. The experimental results show that the method has a good accuracy in human behavior recognition. It is proved that the proposed model not only improves the recognition accuracy, but also effectively reduces the computational complexity of output weights and improves the compactness of the model structure.

A Robust Feature Extraction and Recognition

Human Behavior Feature Representation and Recognition Based on Depth Video

Human Behavior Recognition Based on 3D Features and Hidden Markov Models

Uniform Local Binary Pattern Based Texture-Edge Feature for 3D Human Behavior Recognition.

An Empirical Study for Human Behavior Analysis

Human Facial Expression Recognition Based On 3d Cuboids And Improved K-Means Clustering Algorithm

Robust Feature Extraction For Character Recognition Based On Binary Images

Action Feature Representation and Recognition Based on Depth Video

Human Action Recognition Using Deep Network for Feature Extraction and Kernel Based Nonlinear Representor for Classification

Feature Modeling and Recognition of Object Behavior in 3-D Space

Action Recognition Using Hybrid Feature Descriptor And Vlad Video Encoding

Behavior Recognition Based on the Integration of Multigranular Motion Features

Robust Visual Behavior Recognition

3D Human behavior recognition based on binocular vision and face–hand feature

Human Behavior Recognition Based on Time Correlation Sampling Two-stream Heterogeneous Grafting Network

Human Action Recognition by Using Polyhedron Model-Based Spatio-Temporal Gradient Descriptor

Human Action Recognition Based on Extracted Discriminative Regions

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

Fuzzy system based human behavior recognition by combining behavior prediction and recognition

A spatiotemporal multi-feature extraction framework with space and channel based squeeze-and-excitation blocks for human activity recognition

A 4D strong spatio-temporal feature learning network for behavior recognition of point cloud sequences