Abstract:Context plays a crucial role in visual recognition as it provides complementary clues for different learning tasks including image classification and annotation. As the performances of these tasks are currently reaching a plateau, any extra knowledge, including context, should be leveraged in order to seek significant leaps in these performances. In the particular scenario of kernel machines, context-aware kernel design aims at learning positive semi-definite similarity functions which return high values not only when data share similar contents, but also similar structures (a.k.a contexts). However, the use of context in kernel design has not been fully explored; indeed, context in these solutions is handcrafted instead of being learned. In this paper, we introduce a novel deep network architecture that learns context in kernel design. This architecture is fully determined by the solution of an objective function mixing a content term that captures the intrinsic similarity between data, a context criterion which models their structure and a regularization term that helps designing smooth kernel network representations. The solution of this objective function defines a particular deep network architecture whose parameters correspond to different variants of learned contexts including layerwise, stationary and classwise; larger values of these parameters correspond to the most influencing contextual relationships between data. Extensive experiments conducted on the challenging ImageCLEF Photo Annotation and Corel5k benchmarks show that our deep context networks are highly effective for image classification and the learned contexts further enhance the performance of image annotation.

Multi-label Classification using Deep Multi-order Context-aware Kernel Networks

Deep Context-Aware Kernel Networks

Learning Deep Context-Network Architectures for Image Annotation

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

Spatial-Context-Aware Deep Neural Network for Multi-Class Image Classification

Multi-Instance Multi-Label Learning For Image Categorization Based On Integrated Contextual Information

A Multi-Instance Multi-Label Scene Classification Method Based on Multi-Kernel Fusion

A Unified Modular Framework with Deep Graph Convolutional Networks forMulti-label Image Recognition.

Multi-kernel Multi-Label Learning with Max-Margin Concept Network

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Complex Object Classification

Effective Multi-Modal Multi-Label Learning for Automatic Image Annotation.

Joint multi-label multi-instance learning for image classification

Deep Multimodal Network for Multi-Label Classification.

Learning Kernel for Conditional Moment-Matching Discrepancy-Based Image Classification

Instance-Aware Deep Graph Learning for Multi-Label Classification

Improving Multi-Label Classification Using Scene Cues

Multiple Kernel Learning for Label Relation and Class Imbalance in Multi-Label Learning

Learning Graph Convolutional Networks for Multi-Label Recognition and Applications

Multi-Label Classification with Label Graph Superimposing

Deep Multi-kernel Clustering Network