Abstract:The key problem in human behavior recognition is how to build a spatiotemporal feature extraction and classification network. Aiming at the problem that the existing channel attention mechanism directly pools the global average information of each channel and ignores its local spatial information, this paper proposes two improved channel attention modules, namely the space-time (ST) interaction module of matrix operation and the depth separable convolution module, combined with the research of human behavior recognition. Combined with the superior performance of convolutional neural network (CNN) in image and video processing, a multi-scale convolutional neural network method for human behavior recognition is proposed. Firstly, the behavior video is segmented, and low rank learning is performed on each video segment to extract the corresponding Low rank behavior information, and then these Low rank behavior information are connected on the time axis to obtain the Low rank behavior information of the whole video, so as to effectively capture the behavior information in the video, avoiding tedious extraction steps and various assumptions. The ability of neural network to model human behavior can be transferred and reused in networks with different structures. According to the different characteristics of data features at different network levels, two effective feature difference measurement functions are introduced to reduce the difference between features extracted from different network structures. Experiments on several public datasets show that the proposed method has a good classification effect. The experimental results show that the method has a good accuracy in human behavior recognition. It is proved that the proposed model not only improves the recognition accuracy, but also effectively reduces the computational complexity of output weights and improves the compactness of the model structure.

A Multimodal Behavior Recognition Network with Interconnected Architectures

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

Multi-Net Fusion: Exploring a Brain-Inspired Neural Network Model for Facial Expression Recognition

Multi-level feature fusion network for neuronal morphology classification

Human behaviour recognition and monitoring based on deep convolutional neural networks

MF-Net: a multimodal fusion network for emotion recognition based on multiple physiological signals

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

TriCAFFNet: A Tri-Cross-Attention Transformer with a Multi-Feature Fusion Network for Facial Expression Recognition

A Cross-Modal Fusion Network Based on Self-Attention and Residual Structure for Multimodal Emotion Recognition

Human Behavior Recognition Based on CNN-LSTM Hybrid and Multi-Sensing Feature Information Fusion

A multimodal shared network with a cross-modal distribution constraint for continuous emotion recognition

Bioinspired multisensory neural network with crossmodal integration and recognition

MSF-Net: A Multilevel Spatiotemporal Feature Fusion Network Combines Attention for Action Recognition

Human Interaction Recognition Method Based on Parallel Multi-Feature Fusion Network

Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition

Multi-relations Aware Network for in-the-wild Facial Expression Recognition

Multi-layer Graph Convolution Neural Network for Human Behavior Recognition Incorporating Spatial Attention

A Vision Enhancement and Feature Fusion Multiscale Detection Network

A novel feature fusion network for multimodal emotion recognition from EEG and eye movement signals

A multi-stage dynamical fusion network for multimodal emotion recognition