Abstract:Semantic attributes have been recognized as a more spontaneous manner to describe and annotate image content. It is widely accepted that image annotation using semantic attributes is a significant improvement to the traditional binary or multiclass annotation due to its naturally continuous and relative properties. Though useful, existing approaches rely on an abundant supervision and high-quality training data, which limit their applicability. Two standard methods to overcome small amounts of guidance and low-quality training data are transfer and active learning. In the context of relative attributes, this would entail learning multiple relative attributes simultaneously and actively querying a human for additional information. This paper addresses the two main limitations in existing work: 1) it actively adds humans to the learning loop so that minimal additional guidance can be given and 2) it learns multiple relative attributes simultaneously and thereby leverages dependence amongst them. In this paper, we formulate a joint active learning to rank framework with pairwise supervision to achieve these two aims, which also has other benefits such as the ability to be kernelized. The proposed framework optimizes over a set of ranking functions (measuring the strength of the presence of attributes) simultaneously and dependently on each other. The proposed pairwise queries take the form of which one of these two pictures is more natural? These queries can be easily answered by humans. Extensive empirical study on real image data sets shows that our proposed method, compared with several state-of-the-art methods, achieves superior retrieval performance while requires significantly less human inputs.

Robust Relative Attributes for Human Action Recognition

Attribute-correlated Local Regions for Deep Relative Attributes Learning

Online Robust Action Recognition Based on a Hierarchical Model

Attribute Regularization Based Human Action Recognition.

Human Action Recognition with Contextual Constraints Using a RGB-D Sensor

Human Action Recognition with Attribute Regularization

View-invariant Human Action Recognition Via Robust Locally Adaptive Multi-View Learning

Human Action Recognition Using Deep Learning Methods.

Learning Multiple Relative Attributes with Humans in the Loop

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Combining Sparse And Dense Descriptors With Temporal Semantic Structures For Robust Human Action Recognition

Realistic Human Action Recognition by Fast Hog3d and Self-Organization Feature Map

Attribute-based supervised deep learning model for action recognition

A Study of Relative Motion Point Trajectories for Action Recognition

Learning Weighted Features for Human Action Recognition

Action Recognition With Novel High-Level Pose Features

Robust Human Action Recognition Based on Spatio-Temporal Descriptors and Motion Temporal Templates

Human Action Recognition Based on DMMs, HOGs and Contourlet Transform

Human Action Recognition in Unconstrained Videos by Explicit Motion Modeling

Spatio-temporal Semantic Features for Human Action Recognition.

Human Action Recognition Based on Kinematic Similarity in Real Time.