Abstract:Human action recognition and annotation is an active research topic in computer vision. How to model various actions, varying with time resolution, visual appearance, and others, is a challenging task. In this paper, we propose a boosted exemplar learning (BEL) approach to model various actions in a weakly supervised manner, i.e., only action bag-level labels are provided but action instance level ones are not. The proposed BEL method can be summarized as three steps. First, for each action category, amount of class-specific candidate exemplars are learned through an optimization formulation considering their discrimination and co-occurrence. Second, each action bag is described as a set of similarities between its instances and candidate exemplars. Instead of simply using a heuristic distance measure, the similarities are decided by the exemplar-based classifiers through the multiple instance learning, in which a positive (or negative) video or image set is deemed as a positive (or negative) action bag and those frames similar to the given exemplar in Euclidean Space as action instances. Third, we formulate the selection of the most discriminative exemplars into a boosted feature selection framework and simultaneously obtain an action bag-based detector. Experimental results on two publicly available datasets: the KTH dataset and Weizmann dataset, demonstrate the validity and effectiveness of the proposed approach for action recognition. We also apply BEL to learn representations of actions by using images collected from the Web and use this knowledge to automatically annotate action in YouTube videos. Results are very impressive, which proves that the proposed algorithm is also practical in unconstraint environments.

Boosted Exemplar Learning for human action recognition

Boosted Exemplar Learning for Action Recognition and Annotation

Boosted Multi-Class Semi-Supervised Learning for Human Action Recognition

Knowledge-guided Pre-Training and Fine-Tuning: Video Representation Learning for Action Recognition

Human Action Detection Via Boosted Local Motion Histograms

Human Action Detection by Boosting Efficient Motion Features.

Semi-Supervised Multiple Feature Analysis for Action Recognition

Learning Discriminative Key Poses for Action Recognition

Exemplar-Based Recognition of Human–Object Interactions

Self-supervised pretext task collaborative multi-view contrastive learning for video action recognition

Exploiting Motion Information from Unlabeled Videos for Static Image Action Recognition

Probability-based Method for Boosting Human Action Recognition Using Scene Context.

Action Recognition Using Hybrid Feature Descriptor And Vlad Video Encoding

Human action recognition via multi-view learning.

Hybrid Generative-Discriminative Human Action Recognition by Combining Spatiotemporal Words with Supervised Topic Models

Action Recognition with Actons

GBC: Guided Alignment and Adaptive Boosting CLIP Bridging Vision and Language for Robust Action Recognition

Human Action Recognition Based on Fusion Features Extraction of Adaptive Background Subtraction and Optical Flow Model

Using a Selective Ensemble Support Vector Machine to Fuse Multimodal Features for Human Action Recognition

Graph-based multiple instance learning for action recognition

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform