Abstract:We present a hybrid generative-discriminative learning method for human action recognition from video sequences. Our model combines a bag-of-words component with supervised latent topic models. A video sequence is represented as a collection of spatiotemporal words by extracting space-time interest points and describing these points using both shape and motion cues. The supervised latent Dirichlet allocation (sLDA) topic model, which employs discriminative learning using labeled data under a generative framework, is introduced to discover the latent topic structure that is most relevant to action categorization. The proposed algorithm retains most of the desirable properties of generative learning while increasing the classification performance though a discriminative setting. It has also been extended to exploit both labeled data and unlabeled data to learn human actions under a unified framework. We test our algorithm on three challenging data sets: the KTH human motion data set, the Weizmann human action data set, and a ballet data set. Our results are either comparable to or significantly better than previously published results on these data sets and reflect the promise of hybrid generative-discriminative learning approaches. (C) 2011 Society of Photo-Optical Instrumentation Engineers (SPIE). [DOI: 10.1117/1.3537969]

Action recognition based on space-time interest points and topic model

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

Recognizing Human Actions by Two-Level Beta Process Hidden Markov Model

An Improved Interest Point Detector for Human Action Recognition

A Method for Action Recognition Based on Pose and Interest Points

Action Recognition in Video Using Human Keypoint Detection

Human Action Recognition by Using Polyhedron Model-Based Spatio-Temporal Gradient Descriptor

A Method of Human Action Recognition Based on Spatio-Temporal Interest Points and PLSA

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Action recognition via restricted dense trajectories and spatio-temporal co-occurrence feature

Action recognition using hybrid spatio-temporal bag-of-features

Hybrid Generative-Discriminative Human Action Recognition by Combining Spatiotemporal Words with Supervised Topic Models

Action recognition using a hierarchy of feature groups

Research on Local Spatio-Temporal Features for Action Recognition

Action Recognition by Hidden Temporal Models

Human Action Recognition Based on Extracted Discriminative Regions

Action Recognition Based on Latent Task Learning

View-invariant action recognition using interest points.

Spatio-temporal Semantic Features for Human Action Recognition.

Human Action Recognition Using Multi-Velocity STIPs and Motion Energy Orientation Histogram.