Abstract:Existing action recognition algorithms require a set of positive exemplars to train a classifier for each action. However, the amount of action classes is very large and the users' queries vary dramatically. It is impractical to pre-define all possible action classes beforehand. To address this issue, we propose to perform action recognition with no positive exemplars, which is often known as the zero-shot learning. Current zero-shot learning paradigms usually train a series of attribute classifiers and then recognize the target actions based on the attribute representation. To ensure the maximum coverage of ad-hoc action classes, the attribute-based approaches require large numbers of reliable and accurate attribute classifiers, which are often unavailable in the real world. In this paper, we propose an approach that merely takes an action name as the input to recognize the action of interest without any pre-trained attribute classifiers and positive exemplars. Given an action name, we first build an analogy pool according to an external ontology, and each action in the analogy pool is related to the target action at different levels. The correlation information inferred from the external ontology may be noisy. We then propose an algorithm, namely adaptive multi-model rank-preserving mapping (AMRM), to train a classifier for action recognition, which is able to evaluate the relatedness of each video in the analogy pool adaptively. As multiple mapping models are employed, our algorithm has better capability to bridge the gap between visual features and the semantic information inferred from the ontology. Extensive experiments demonstrate that our method achieves the promising performance for action recognition only using action names, while no attributes and positive exemplars are available.

TUA 1 at the NTCIR-13 Actionable Knowledge Graph Task : Sampling Related Actions from Online Searching

Toward action comprehension for searching: Mining actionable intents in query entities

Search Action Sequence Modeling With Long Short-Term Memory For Search Task Success Evaluation

Automatic extraction of relevant video shots of specific actions exploiting Web data

KGO at the NTCIR-12 Temporalia Task: Exploring Temporal Information in Search Queries.

Utilizing Related Samples to Enhance Interactive Concept-Based Video Search

TA2N: Two-Stage Action Alignment Network for Few-Shot Action Recognition.

Recognizing an Action Using Its Name: A Knowledge-Based Approach

LAP-Net: Adaptive Features Sampling via Learning Action Progression for Online Action Detection

SRG: Snippet Relatedness-Based Temporal Action Proposal Generator

Actively Mining Search Logs for Diverse Tags.

Action Recognition by Exploring Data Distribution and Feature Correlation

TUTA1 at the NTCIR-11 Temporalia Task.

Task-Specific Alignment and Multiple Level Transformer for Few-Shot Action Recognition

THUNLP at TAC KBP 2011 in Entity Linking.

Utilizing Related Samples to Learn Complex Queries in Interactive Concept-Based Video Search

Learning to Refactor Action and Co-occurrence Features for Temporal Action Localization

Attention-driven Action Retrieval with DTW-based 3d Descriptor Matching.

Task-adaptive Spatial-Temporal Video Sampler for Few-shot Action Recognition

Searching For Actions On The Hyperbole

Task-specific alignment and multiple-level transformer for few-shot action recognition