Abstract:Human action recognition from videos requires a sequence of frames to be analyzed involving high processing power and time. Moreover, subsequent frames in a video contain redundancy that does not contribute to extracting distinguishable features but rather consumes processing resources. To recognize action with lower processing overhead, researchers are focusing on key frames and have proposed different techniques based on inter-frame clustering, fix-frame interval, and inter-frame differences. Clustering and fixed interval approaches consider the predefined number of frames or fixed intervals, therefore, not equally effective for both faster and slower actions which differ in terms of frequency of change. Furthermore, all existing approaches consider pixels? Intensities only but neglect another equally important aspect of motion, i.e., direction. The three-channel optical flows are one of the motion representations that depict both the magnitude and the direction of movement between pairs of frames in the form of colors. Here we proposed a novel "KFF-algorithm" that processes a sequence of three-channel optical flows to extract key flow frames for action recognition. Being dynamic in terms of frame interval, it efficiently extracts key frames for both slower and faster actions by analyzing changes in direction, magnitude, and coverage of motion in subsequent frames. Furthermore, in comparison with other approaches, KFF-algorithm covers relatively extended motion patterns with least number of frames or frames with significant change only. Also, for the majority of classes, KFF-algorithm has achieved substantial per-class accuracy when evaluated with the 3D-ConvNet model over the UCF-101 benchmark dataset for human action recognition.

Video Action Recognition Using spatio-temporal optical flow video frames

Real-time Human Action Recognition Based on Optical-flow Feature and Sequence Alignment

Human Action Recognition Using Deep Learning Methods.

A fast human action recognition network based on spatio-temporal features

Human Action Recognition From Digital Videos Based on Deep Learning.

A real-time algorithm for human action recognition in RGB and thermal video

Human Action Recognition Based on Three-Stream Network with Frame Sequence Features

On the Integration of Optical Flow and Action Recognition

A Novel Key Flow Frame Selection Method for Video Classification

Action Recognition in Videos through a Transfer-Learning-Based Technique

Deep Neural Networks in Video Human Action Recognition: A Review

Action Recognition By Learning Deep Multi-Granular Spatio-Temporal Video Representation

Im2Flow: Motion Hallucination from Static Images for Action Recognition

Fast and Reliable Human Action Recognition in Video Sequences by Sequential Analysis

Video-based Human Action Recognition using Deep Learning: A Review

ActAR: Actor-Driven Pose Embeddings for Video Action Recognition

Joint Dynamic Pose Image and Space Time Reversal for Human Action Recognition from Videos

Channel Attention-Based Approach with Autoencoder Network for Human Action Recognition in Low-Resolution Frames

Deep Learning-Based Human Action Recognition in Videos

Human action recognition in videos using motion impression image

Machine Vision-Based Human Action Recognition Using Spatio-Temporal Motion Features (STMF) with Difference Intensity Distance Group Pattern (DIDGP)