Abstract:Human action recognition from videos is a challenging task in computer vision. In recent years, histogram-based descriptors that are calculated along dense trajectories have shown promising results for human action recognition, but they usually ignore motion information of the tracking points, and the relationship between different motion variables is not well utilized. To address this issue, we propose a motion keypoint trajectory (MKT) approach and a trajectory-based covariance (TBC) descriptor, which is calculated along the motion keypoint trajectories. The proposed MKT approach tracks motion keypoints at multiple spatial scales and employs an optical flow rectification algorithm to reduce the influence of camera motions and thus achieves better performance than the improved dense trajectory (IDT) approach well known in the literature. In particular, MKT is faster than IDT, because MKT does not need to use human detection and extracts fewer trajectories than IDT. Furthermore, the TBC descriptor outperforms the classical histogram-based descriptors, such as the Histogram of Oriented Gradient, Histogram of Optical Flow and Motion Boundary Histogram. Experimental results on three challenging datasets (i.e., Olympic Sports, HMDB51 and UCF50) demonstrate that our approach is able to achieve better recognition performances than a number of state-of-the-art approaches.

Tracking Salient Keypoints for Human Action Recognition

Based on cluster tree human action recognition algorithm for monocular video

Multiple Human Tracking Using Blob Extraction and Action Recognition Using HOG

A Study of Relative Motion Point Trajectories for Action Recognition

Trajectory-Based Modeling Of Human Actions With Motion Reference Points

How Does Human Interest Modeling Help in Computer Vision: Tracking-by-saliency in Unconstrained Social Videos.

Motion keypoint trajectory and covariance descriptor for human action recognition

Human action recognition in videos based on dense trajectory selection

Human Action Recognition Using Deep Learning Methods.

Action Recognition in Video Using Human Keypoint Detection

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Features extraction approach based on dense salient trajectories in videos

Human Action Recognition Based On Oriented Motion Salient Regions

Human Activity Recognition Based on Pose Points Selection

Human action recognition with salient trajectories and multiple kernel learning

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.

Action recognition via restricted dense trajectories and spatio-temporal co-occurrence feature

Robust Detection and Localization of Human Action in Video.

Human Action Recognition Based on Action Relevance Weighted Encoding

Action Recognition Based on Object Tracking and Dense Trajectories

Human action recognition in videos using motion impression image