Abstract:Action recognition in videos is a difficult and challenging task. Recent developed deep learning-based action recognition methods have achieved the state-of-the-art performance on several action recognition benchmarks. However, it is noted that these methods are inefficient since they are of large model size and require long runtime which restrict their practical applications. In this study, we focus on improving the accuracy and efficiency of action recognition following the two-stream ConvNets by investigating the effective video-level representations. Our motivation stems from the observation that redundant information widely exists in adjacent frames in the videos and humans do not recognize actions based on frame-level features. Therefore, to extract the effective video-level features, a Hierarchical Temporal Pooling (HTP) module is proposed and a two-stream action recognition network termed as HTP-Net (Two-stream) is developed, which is carefully designed to obtain effective video-level representations by hierarchically incorporating the temporal motion and spatial appearance features. It is worth noting that all two-stream action recognition methods using optical flow as one of the inputs are computationally inefficient since calculating optical flow is time-consuming. To improve the efficiency, in our study, we do not consider using optical flow but consider only raw RGB as input to our HTP-Net termed as HTP-Net (RGB) for a clear and concise presentation. Extensive experiments have been conducted on two benchmarks: UCF101 and HMDB51. Experimental results demonstrate that HTP-Net (Two-stream) achieves the state-of-the-art performance and HTP-Net (RGB) offers competitive action recognition accuracy but is approximately 1-2 orders of magnitude faster than other state-of-the-art single stream action recognition methods. Specifically, our HTP-Net (RGB) runs at 42 videos per second (vps) and 672 frames per second (fps) on an NVIDIA Titan X GPU, which enables real-time action recognition and is of great value in practical applications.

Accelerating Large-Scale Human Action Recognition with GPU-Based Spark

Large-scale Human Action Recognition with Spark

GPU-Framework for Teamwork Action Recognition

Human Action Recognition Using Deep Learning Methods.

Combining Multi-scale Directed Depth Motion Maps and Log-Gabor Filters for Human Action Recognition

SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition

Distributed Interactive Visualization Using GPU-Optimized Spark

Scalable Traffic Predictive Analysis using GPU in Big Data

Hierarchical Temporal Pooling for Efficient Online Action Recognition.

A fast human action recognition network based on spatio-temporal features

Accelerating Large-Scale Image Retrieval On Heterogeneous Architectures With Spark

Fast Face Recognition on GPUs

GFNet: A Lightweight Group Frame Network for Efficient Human Action Recognition.

Human Action Recognition Based on Hierarchical Multi-Scale Adaptive Conv-Long Short-Term Memory Network

The Spike Gating Flow: A Hierarchical Structure Based Spiking Neural Network for Online Gesture Recognition

Parallelizing Abnormal Event Detection in Crowded Scenes with GPU

High Speed Human Action Recognition using a Photonic Reservoir Computer

Parallelizing Convolutional Neural Networks for Action Event Recognition in Surveillance Videos

Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessment

GTAutoAct: An Automatic Datasets Generation Framework Based on Game Engine Redevelopment for Action Recognition

GPU accelerated face detection