Abstract:In the field of human action recognition (HAR), two-stream models have been widely employed. In recent years, traditional two-stream network models have disregarded the interframe sequence characteristics of video, resulting in a decrease in model robustness when local sequence information and long-term motion information interact. In light of this, a novel three-stream neural network is proposed by combining the long-term and short-term characteristics of a frame sequence with spatio-temporal information. Initially, the optical flow sequence image frames and RGB image frames in the video are extracted, the optical flow motion information and image space information in the video is obtained, the corresponding time network and space network are entered, and the spatial information is entered into the sequence feature processing network; the three networks are then pretrained. At the conclusion of training, the operation of feature extraction is executed, the features are incorporated with the parallel fusion algorithm by adding weights, and the behavior categories are classified using Multi-Layer Perception. Experimental results on the UCF11, UCF50, and HMDB51 datasets demonstrate that our model effectively integrates the spatial-temporal and frame-sequence information of human actions, resulting in a significant improvement in recognition accuracy. Its classification accuracy on the three datasets was 99.17%, 97.40%, and 96.88%, respectively, significantly enhancing the generalization capability and validity of conventional two-stream or three-stream models.

Human action recognition in videos using hybrid motion features

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

Human action recognition in videos using motion impression image

Multimodal human action recognition based on spatio-temporal action representation recognition model

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Human Action Recognition Based on Motion Feature and Manifold Learning

DMMs-Based Multiple Features Fusion for Human Action Recognition

Human Action Recognition Based on HOIRM Feature Fusion and AP Clustering BOW.

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

Human action recognition using Adaptive Hierarchical Depth Motion Maps and Gabor filter

Action recognition and detection by combining motion and appearance features

Embedding Motion and Structure Features for Action Recognition

Human Action Recognition under Log-Euclidean Riemannian Metric.

Learning and Distillating the Internal Relationship of Motion Features in Action Recognition.

I Know How You Move: Explicit Motion Estimation for Human Action Recognition

Human action recognition via multi-view learning.

Joint Dynamic Pose Image and Space Time Reversal for Human Action Recognition from Videos

Subspace Analysis Methods Plus Motion History Image for Human Action Recognition