Abstract:In computer vision, human action recognition is a hot topic, popularized by the development of deep learning. Deep learning models typically accept video input without prior processing and train them to achieve recognition. However, conducting preliminary motion analysis can be beneficial in directing the model training to prioritize the motion of individuals with less priority for the environment in which the action occurs. This paper puts forth a novel methodology for human action recognition based on motion information that employs transfer-learning techniques. The proposed method comprises four stages: (1) human detection and tracking, (2) motion estimation, (3) feature extraction, and (4) action recognition using a two-stream model. In order to develop this work, a customized dataset was utilized, comprising videos of diverse actions (e.g., walking, running, cycling, drinking, and falling) extracted from multiple public sources and websites, including Pexels and MixKit. This realistic and diverse dataset allowed for a comprehensive evaluation of the proposed method, demonstrating its effectiveness in different scenarios and conditions. Furthermore, the performance of seven pre-trained models for feature extraction was evaluated. The models analyzed were Inception-v3, MobileNet-v2, MobileNet-v3-L, VGG-16, VGG-19, Xception, and ConvNeXt-L. The results demonstrated that the ConvNeXt-L model yielded the most optimal outcomes. Furthermore, using pre-trained models for feature extraction facilitated the training process on a personal computer with a single graphics processing unit, achieving an accuracy of 94.9%. The experimental findings and outcomes suggest that integrating motion information enhances action recognition performance.

Improved Convolutional 3D Networks for Micro-Movements Recognition

DC3D: A Video Action Recognition Network Based on Dense Connection

Human Action Recognition From Digital Videos Based on Deep Learning.

Human Action Recognition Using Deep Learning Methods.

An Improved Human Action Recognition Method Based on 3D Convolutional Neural Network

MiCT: Mixed 3D/2D Convolutional Tube for Human Action Recognition

3D Convolutional Neural Network for Action Recognition.

Convolutional transformer network for fine-grained action recognition

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences

Action recognition method based on a novel keyframe extraction method and enhanced 3D convolutional neural network

3-Stream Convolutional Networks for Video Action Recognition with Hybrid Motion Field

Efficient Action Recognition with Introducing R(2+1)D Convolution to Improved Transformer

Human Action Recognition Combining Sequential Dynamic Images and Two-Stream Convolutional Network

A Fine-to-Coarse Convolutional Neural Network for 3D Human Action Recognition

Action Recognition in Videos through a Transfer-Learning-Based Technique

Action Recognition in Videos with Temporal Segments Fusions

RGB-D Based Action Recognition with Light-weight 3D Convolutional Networks

Shift Swin Transformer Multimodal Networks for Action Recognition in Videos

3D-TDC: A 3D temporal dilation convolution framework for video action recognition