Abstract:In assisted living facilities or nursing homes, residents' movements or actions can be monitored using Human Activity Recognition (HAR), ensuring they receive proper care and attention. The significance of HAR is substantial in reviewing and updating emergency response plans to address unusual behavior patterns of individuals in the context of daily living activities. Recognizing activity from video data entails extracting spatial features and subsequently determining the temporal variations across these extracted spatial parameters. A specified number of frames is required to be sampled to analyze video data in recognizing the association of semantic information across the sequential frames. Even while sample frames engage in an essential function, they are often selected at random or skipped sequentially, resulting in temporal data loss. A proper video summary that retains the originality of the video while presenting the most important details might be a solution to the problem highlighted. Addressing the issue, we propose a cluster-based approach for selecting keyframes that facilitates generating video summarization by extracting the relevant frames. Additionally, we explore two different deep learning strategies for recognizing action to assess the effective one: (a) pose-based activity recognition model and (b) single hybrid pre-trained CNN-LSTM model. The experimental findings demonstrate the efficacy of the single hybrid CNN-LSTM technique. Our proposed model yields a mean accuracy of 95.56% for the RGB video data modality, surpassing the performance of several recent works of multimodal using the MSRDailyActivity3D dataset. In addition, the proposed model is evaluated using two challenging datasets: PRECIS HAR and UCF11. Our proposed single hybrid CNN-LSTM model achieves 95.12% precision, 95.11% recall, and 95.03% f1 score on the MSRDailyActivity3D dataset.

Human activity recognition in RGB-D videos by dynamic images

A human activity recognition framework in videos using segmented human subject focus

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Joint Dynamic Pose Image and Space Time Reversal for Human Action Recognition from Videos

Multi-view Multi-modal Approach Based on 5S-CNN and BiLSTM Using Skeleton, Depth and RGB Data for Human Activity Recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Human Action Recognition Using Deep Learning Methods.

Video-Based Human Activity Recognition Using Deep Learning Approaches

3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks

A Multimodal Fusion Approach for Human Activity Recognition

Feature Learning for Interaction Activity Recognition in RGBD Videos

NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding

Human activity recognition using deep learning approaches and single frame cnn and convolutional lstm

Human Activity Recognition Based On Video Summarization And Deep Convolutional Neural Network

Dynamic Action Recognition: A convolutional neural network model for temporally organized joint location data

Skeleton Focused Human Activity Recognition in RGB Video

A hybrid deep learning framework for daily living human activity recognition with cluster-based video summarization

A real-time algorithm for human action recognition in RGB and thermal video

A Multi-viewpoint Outdoor Dataset for Human Action Recognition

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

Enhancing Human Activity Recognition through Integrated Multimodal Analysis: A Focus on RGB Imaging, Skeletal Tracking, and Pose Estimation