Abstract:The key problem in human behavior recognition is how to build a spatiotemporal feature extraction and classification network. Aiming at the problem that the existing channel attention mechanism directly pools the global average information of each channel and ignores its local spatial information, this paper proposes two improved channel attention modules, namely the space-time (ST) interaction module of matrix operation and the depth separable convolution module, combined with the research of human behavior recognition. Combined with the superior performance of convolutional neural network (CNN) in image and video processing, a multi-scale convolutional neural network method for human behavior recognition is proposed. Firstly, the behavior video is segmented, and low rank learning is performed on each video segment to extract the corresponding Low rank behavior information, and then these Low rank behavior information are connected on the time axis to obtain the Low rank behavior information of the whole video, so as to effectively capture the behavior information in the video, avoiding tedious extraction steps and various assumptions. The ability of neural network to model human behavior can be transferred and reused in networks with different structures. According to the different characteristics of data features at different network levels, two effective feature difference measurement functions are introduced to reduce the difference between features extracted from different network structures. Experiments on several public datasets show that the proposed method has a good classification effect. The experimental results show that the method has a good accuracy in human behavior recognition. It is proved that the proposed model not only improves the recognition accuracy, but also effectively reduces the computational complexity of output weights and improves the compactness of the model structure.

Exploring a Humanoid Video-Understanding Algorithm Guided by Behavior.

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Human Action Recognition Using Deep Learning Methods.

How Does Human Interest Modeling Help in Computer Vision: Tracking-by-saliency in Unconstrained Social Videos.

Hybrid Deep Model for Human Behavior Understanding on Industrial Internet of Video Things

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

3D Convolutional Neural Network for Human Behavior Analysis in Intelligent Sensor Network

Human Behavior Recognition from Multiview Videos

Human–robot interaction-oriented video understanding of human actions

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

Human-like Visual Learning and Reasoning

Dynamic Human Behavior Pattern Detection and Classification

Joint Motion Information Extraction and Human Behavior Recognition in Video Based on Deep Learning

Inferring Human Intent from Video by Sampling Hierarchical Plans

Human-centric Behavior Description in Videos: New Benchmark and Model

Deep Learning-Based Recognition and Visualization of Human Motion Behavior

Human Behavior Feature Representation and Recognition Based on Depth Video

3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks

ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning

Human Behavior Recognition Based on Attention Mechanism and Bottleneck Residual Dual-Path Spatiotemporal Graph Convolutional Network

Human behaviour recognition and monitoring based on deep convolutional neural networks