Abstract:Human action recognition in videos is one of the most important and active topics in computer vision, and building more discriminative video representation is crucial for action classification. In this paper, we propose a new video representation which not only captures temporal dynamics in a video but also takes account of the importance of different trajectories and video frames in action recognition. More specifically, first, we propose a new trajectory descriptor based on traditionally used local descriptors including histograms of oriented gradients, histograms of optical flow and motion boundary histogram, and it takes the correlation between trajectories and target action into consideration. Secondly, a new method to compute saliency map based on optical flow is introduced to highlight regions of foreground motion. Thirdly, to identify discriminating trajectories and frames in a video, trajectory action relevance and frame action relevance are defined and used as weights during encoding. Finally, two video representations which describe a video at different levels of abstraction are proposed, they are complementary to each other and combined to generate more expressive and discriminative representation. Experimental results on KTH, JHMDB and HMDB51 demonstrate the effectiveness and excellent performance of the proposed approach.

Effective Video Feature for Action Recognition

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

Action Recognition Using Hybrid Feature Descriptor And Vlad Video Encoding

Human Action Recognition Based on Multi-feature Fusion of SVD and 3D-SIFT Features

Human Action Recognition Based on Action Relevance Weighted Encoding

Human Action Recognition Based on Fusion Features Extraction of Adaptive Background Subtraction and Optical Flow Model

Action Recognition Using Form and Motion Modalities

Action Recognition in Video Using Human Keypoint Detection

Multi-feature Fusion Action Recognition Based on Key Frames.

Action recognition based on the angle histogram of key parts

Adaptive feature selection method for action recognition of human body in RGBD data

Video Based Action Recognition Using Spatial and Temporal Feature

Action recognition using a hierarchy of feature groups

Multi-feature fusion based human action recognition algorithm

Human action recognition in videos using hybrid motion features

Action recognition based on kinematic representation of video data

Efficient Object Feature Selection For Action Recognition

An Efficient Motion Visual Learning Method for Video Action Recognition

Analysis of Human Actions for Video Indexing

An Improved Method Using Kinematic Features for Action Recognition

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling