Abstract:In the field of human action recognition (HAR), two-stream models have been widely employed. In recent years, traditional two-stream network models have disregarded the interframe sequence characteristics of video, resulting in a decrease in model robustness when local sequence information and long-term motion information interact. In light of this, a novel three-stream neural network is proposed by combining the long-term and short-term characteristics of a frame sequence with spatio-temporal information. Initially, the optical flow sequence image frames and RGB image frames in the video are extracted, the optical flow motion information and image space information in the video is obtained, the corresponding time network and space network are entered, and the spatial information is entered into the sequence feature processing network; the three networks are then pretrained. At the conclusion of training, the operation of feature extraction is executed, the features are incorporated with the parallel fusion algorithm by adding weights, and the behavior categories are classified using Multi-Layer Perception. Experimental results on the UCF11, UCF50, and HMDB51 datasets demonstrate that our model effectively integrates the spatial-temporal and frame-sequence information of human actions, resulting in a significant improvement in recognition accuracy. Its classification accuracy on the three datasets was 99.17%, 97.40%, and 96.88%, respectively, significantly enhancing the generalization capability and validity of conventional two-stream or three-stream models.

Based on cluster tree human action recognition algorithm for monocular video

Online Robust Action Recognition Based on a Hierarchical Model

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Human Action Recognition Based on Kinematic Similarity in Real Time.

Action Recognition Based on Global Optimal Similarity Measuring

Human Action Recognition Based on Human Skeleton Hu Invariant Moments Combined with Human Geometrical Characteristics

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Human 3D Model-based 2D Action Recognition

Human Skeleton Action Recognition Based on Monocular Depth Estimation

Human motion recognition using three-dimensional skeleton model based on RGBD vision system

Action Segmentation And Recognition Based On Depth Hog And Probability Distribution Difference

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human action recognition based on Non-linear SVM Decision Tree

Oriented Gradients for Human Action Recognition.

Real-Time Human Action Recognition System Using Depth Map Sequences

Human action recognition: A novel application of the stochastic detector enriched by body-parts information

Hidden Markov Model for Action Recognition Using Joint Angle Acceleration.

Human Motion Recognition in Video

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Human Action Recognition from Video Sequences by Enforcing Tri-view Constraints