Abstract:Human action recognition is a promising yet non-trivial computer vision field with many potential applications. Current advances in bag-of-feature approaches have brought significant insights into recognizing human actions for various practical purposes. It is, however, a common practice in literature to consider a set of local feature descriptors with uniform contributions. This assumption has been shown to be oversimplified, which limit these works from robust deployments in real-life video content retrieval. In this work, we propose and show that, by taking into account global configuration of local features, we can greatly improve the recognition performance. A novel feature selection process is also devised with the help of Sparse Hierarchical Bayes Filter, an additional process to boost the traditional bag-of-feature learning. We further introduce the usage of structured learning for the problem of human action recognition. That is, by representing one human action as a complex set of local features, a set of feature functions can be utilized to discriminatively infer the structured output for action classification and action localization. In particular, we tackle the problem of action localization in video using structured learning and we compare two two options: One is Dynamic Conditional Random Field from probabilistic principle; The other is Structured Support Vector Machine from max-margin principle. We evaluate our modular classification-localization framework on various testbeds, where the proposed framework is demonstrated by its competitive performance comparing with the state-of-the-art methods.

Probability-based Method for Boosting Human Action Recognition Using Scene Context.

Seeing Actions Through Scene Context

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Action-scene Model for Human Action Recognition from Videos

Human Action Detection Via Boosted Local Motion Histograms

LSTC: Boosting Atomic Action Detection with Long-Short-Term Context.

Boosting Classifiers for Scene Category Recognition.

Spatial-Temporal Context for Action Recognition Combined with Confidence and Contribution Weight

Action-Scene Model For Recognizing Human Actions From Background In Realistic Videos

Action recognition based on space-time interest points and topic model

Recognizing Human Actions by BP-AdaBoost Algorithm under a Hierarchical Recognition Framework

Learning Semantic Context Feature-Tree for Action Recognition Via Nearest Neighbor Fusion.

Human Action Detection by Boosting Efficient Motion Features.

Action Recognition Using 3d Histograms of Texture and A Multi-Class Boosting Classifier

Boosted Exemplar Learning for human action recognition

Human action recognition based on multi-feature fusion and hierarchical BP-AdaBoost algorithm

Action Recognition Using Context and Appearance Distribution Features

Action recognition in still images using a combination of human pose and context information

Probabilistic and Max-margin structured learning in Human Action Recognition

Realistic Human Action Recognition with Audio Context

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection