Abstract:We present a hybrid generative-discriminative learning method for human action recognition from video sequences. Our model combines a bag-of-words component with supervised latent topic models. A video sequence is represented as a collection of spatiotemporal words by extracting space-time interest points and describing these points using both shape and motion cues. The supervised latent Dirichlet allocation (sLDA) topic model, which employs discriminative learning using labeled data under a generative framework, is introduced to discover the latent topic structure that is most relevant to action categorization. The proposed algorithm retains most of the desirable properties of generative learning while increasing the classification performance though a discriminative setting. It has also been extended to exploit both labeled data and unlabeled data to learn human actions under a unified framework. We test our algorithm on three challenging data sets: the KTH human motion data set, the Weizmann human action data set, and a ballet data set. Our results are either comparable to or significantly better than previously published results on these data sets and reflect the promise of hybrid generative-discriminative learning approaches. (C) 2011 Society of Photo-Optical Instrumentation Engineers (SPIE). [DOI: 10.1117/1.3537969]

Human Action Recognition by Bagging Data Dependent Representation

A Method of Simultaneously Action Recognition and Video Segmentation of Video Streams.

Human Action Recognition Using Deep Learning Methods.

Human Action Recognition Based on Extracted Discriminative Regions

A distribution based video representation for human action recognition

Reassessing Hierarchical Representation for Action Recognition in Still Images

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Learning Weighted Features for Human Action Recognition

Human action recognition: A novel application of the stochastic detector enriched by body-parts information

Human Action Recognition Based on Discriminative Supervoxels

Action Recognition by Exploring Data Distribution and Feature Correlation

Human Action Recognition with Optimized Video Densely Sampling.

Hybrid Generative-Discriminative Human Action Recognition by Combining Spatiotemporal Words with Supervised Topic Models

Human Action Recognition Via Multi-Task Learning Base on Spatial-Temporal Feature

Action Recognition by Mid-Level Discriminative Spatial-Temporal Volume

Human action classification based on sequential bag-of-words model

Action classification by exploring directional co-occurrence of weighted stips

Exploring Probabilistic Localized Video Representation for Human Action Recognition

Action recognition using hybrid spatio-temporal bag-of-features

Learning Discriminative Key Poses for Action Recognition

Human action recognition in videos using hybrid motion features