Abstract:Context plays a crucial role in visual recognition as it provides complementary clues for different learning tasks including image classification and annotation. As the performances of these tasks are currently reaching a plateau, any extra knowledge, including context, should be leveraged in order to seek significant leaps in these performances. In the particular scenario of kernel machines, context-aware kernel design aims at learning positive semi-definite similarity functions which return high values not only when data share similar contents, but also similar structures (a.k.a contexts). However, the use of context in kernel design has not been fully explored; indeed, context in these solutions is handcrafted instead of being learned. In this paper, we introduce a novel deep network architecture that learns context in kernel design. This architecture is fully determined by the solution of an objective function mixing a content term that captures the intrinsic similarity between data, a context criterion which models their structure and a regularization term that helps designing smooth kernel network representations. The solution of this objective function defines a particular deep network architecture whose parameters correspond to different variants of learned contexts including layerwise, stationary and classwise; larger values of these parameters correspond to the most influencing contextual relationships between data. Extensive experiments conducted on the challenging ImageCLEF Photo Annotation and Corel5k benchmarks show that our deep context networks are highly effective for image classification and the learned contexts further enhance the performance of image annotation.

Contextual Kernel and Spectral Methods for Learning the Semantics of Images

Learning A Semantic Space from User'S Relevance Feedback for Image Retrieval

Image Classification with Kernelized Spatial-Context.

Context Dependent SVMs for Interconnected Image Network Annotation

A Semantic Context Model For Automatic Image Annotation

Context-Based Support Vector Machines for Interconnected Image Annotation

Learning Deep Context-Network Architectures for Image Annotation

Exploiting Semantic And Visual Context For Effective Video Annotation

Visual Vocabulary Optimization with Spatial Context for Image Annotation and Classification

Learning Semantics for Image Annotation

Deep Context-Aware Kernel Networks

Kernel-based Image Classification Using the Context of Visual Words

Context-Aware Image Inpainting with Learned Semantic Priors.

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Semantic context learning with large-scale weakly-labeled image set.

Exploiting Spatial Context Constraints for Automatic Image Region Annotation.

Towards Multi-Semantic Image Annotation with Graph Regularized Exclusive Group Lasso

Exploring Statistical Properties for Semantic Annotation: Sparse Distributed and Convergent Assumptions for Keywords

A Probabilistic Semantic Model for Image Annotation and Multi-Modal Image Retrieval

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Exploiting Multi-Context Analysis in Semantic Image Classification