Abstract:Action recognition (AR) has many applications, including surveillance, health/disabilities care, man-machine interactions, video-content-based monitoring, and activity recognition. Because human action videos contain a large number of frames, implemented models must minimize computation by reducing the number, size, and resolution of frames. We propose an improved method for detecting human actions in low-size and low-resolution videos by employing convolutional neural networks (CNNs) with channel attention mechanisms (CAMs) and autoencoders (AEs). By enhancing blocks with more representative features, convolutional layers extract discriminating features from various networks. Additionally, we use random sampling of frames before main processing to improve accuracy while employing less data. The goal is to increase performance while overcoming challenges such as overfitting, computational complexity, and uncertainty by utilizing CNN-CAM and AE. Identifying patterns and features associated with selective high-level performance is the next step. To validate the method, low-resolution and low-size video frames were used in the UCF50, UCF101, and HMDB51 datasets. Additionally, the algorithm has relatively minimal computational complexity. Consequently, the proposed method performs satisfactorily compared to other similar methods. It has accuracy estimates of 77.29, 98.87, and 97.16%, respectively, for HMDB51, UCF50, and UCF101 datasets. These results indicate that the method can effectively classify human actions. Furthermore, the proposed method can be used as a processing model for low-resolution and low-size video frames.

AR-C3D: Action Recognition Accelerator for Human-Computer Interaction on FPGA

Cloud-Edge Collaborative Human Activity Recognition System Design and Implementation.

FMM-X3D: FPGA-based modeling and mapping of X3D for Human Action Recognition

A Single-Chip 600-Fps Real-Time Action Recognition System Employing a Hardware Friendly Algorithm.

Design and Hardware Implementation of CNN-GCN Model for Skeleton-Based Human Action Recognition

FPGA-QHAR: Throughput-Optimized for Quantized Human Action Recognition on The Edge

HARFLOW3D: A Latency-Oriented 3D-CNN Accelerator Toolflow for HAR on FPGA Devices

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

Channel Attention-Based Approach with Autoencoder Network for Human Action Recognition in Low-Resolution Frames

TEINet: Towards an Efficient Architecture for Video Recognition.

FieldHAR: A Fully Integrated End-to-end RTL Framework for Human Activity Recognition with Neural Networks from Heterogeneous Sensors

fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs

DC3D: A Video Action Recognition Network Based on Dense Connection

D3D: Dual 3-D Convolutional Network for Real-Time Action Recognition

3D CNN Acceleration on FPGA using Hardware-Aware Pruning

Attention-Oriented Action Recognition for Real-Time Human-Robot Interaction

A Real-Time Action Representation With Temporal Encoding and Deep Compression

Real-Time Human Action Recognition on Embedded Platforms

Improving Action Recognition with the Graph-Neural-Network-based Interaction Reasoning

An FPGA-Based Energy-Efficient Reconfigurable Convolutional Neural Network Accelerator for Object Recognition Applications

A High-performance Hardware Accelerator Using a Fusion Approach of Convolution and Pooling