Abstract:Automating tasks through human activity recognition in video data has become increasingly vital. Deep learning has yielded versatile activity recognition systems applicable in surveillance, healthcare analysis, sports, and human–computer interaction. Despite various proposed video-based activity recognition techniques over the years, the reliance over RGB frames, accompanied by other modalities like joint locations and depth maps, often proves less effective compared to multimodal methods. In response to this challenge, our paper introduces a competitive approach for identifying human activity in video frames. Leveraging a Convolutional Long Short-Term Memory (Conv-LSTM) network and a novel pre-processing step involving a Human Segmentation network, our method accentuates human subjects in each frame using segmentation maps. These highlighted frames undergo further processing through Convolutional Neural Networks (CNNs) to learn feature vectors, without including other modalities with RGB frames directly. The learned features are then subjected to Long Short-Term Memory (LSTM) units for comprehending sequential video data and drawing meaningful inferences. The proposed methodology undergoes rigorous testing on three publicly available datasets—KARD, MSR Daily Activity, and SBU-Interactions. Remarkably, our approach outperforms similar state-of-the-art methods, achieving benchmark accuracy scores exceeding 98% on MSR Daily Activity and 99% on KARD and SBU-Interactions datasets. In essence, our method not only provides a competitive solution for human activity recognition in video frames but also contributes to advancing the field by integrating Conv-LSTM networks and innovative pre-processing techniques. The comprehensive evaluation on multiple datasets underlines the robustness and superior performance of our proposed approach.

Graph-based Sparse Coding and Embedding for Activity-Based Human Identification

Learning Visual Context for Group Activity Recognition.

Activity-based person identification using sparse coding and discriminative metric learning.

Activity-Based Human Identification

Activity-Based Person Identification Using Discriminative Sparse Projections And Orthogonal Ensemble Metric Learning

P-Laplacian Regularized Sparse Coding for Human Activity Recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human Activities Prediction by Learning Combinatorial Sparse Representations.

An Empirical Study for Human Behavior Analysis

A Graph-based Approach to Human Activity Recognition

Skeleton-based Group Activity Recognition via Spatial-Temporal Panoramic Graph

Structured Feature-Graph Model for Human Activity Recognition

Human Activity Recognition with Posture Tendency Descriptors on Action Snippets

Skeleton-Based Action Recognition with Spatial-Structural Graph Convolution

A motion-aware and temporal-enhanced Spatial–Temporal Graph Convolutional Network for skeleton-based human action segmentation

Spatio-Temporal Action Graph Networks

A human activity recognition method based on Vision Transformer

Improved Actor Relation Graph based Group Activity Recognition

A Human Activity Recognition System Based on Dynamic Clustering of Skeleton Data

A human activity recognition framework in videos using segmented human subject focus

A Compact Representation of Human Actions by Sliding Coordinate Coding