Abstract:In this paper, we propose a new exemplar-based multi-view domain generalization (EMVDG) framework for visual recognition by learning robust classifier that are able to generalize well to arbitrary target domain based on the training samples with multiple types of features (i.e., multi-view features). In this framework, we aim to address two issues simultaneously. First, the distribution of training samples (i.e., the source domain) is often considerably different from that of testing samples (i.e., the target domain), so the performance of the classifiers learnt on the source domain may drop significantly on the target domain. Moreover, the testing data are often unseen during the training procedure. Second, when the training data are associated with multi-view features, the recognition performance can be further improved by exploiting the relation among multiple types of features. To address the first issue, considering that it has been shown that fusing multiple SVM classifiers can enhance the domain generalization ability, we build our EMVDG framework upon exemplar SVMs (ESVMs), in which a set of ESVM classifiers are learnt with each one trained based on one positive training sample and all the negative training samples. When the source domain contains multiple latent domains, the learnt ESVM classifiers are expected to be grouped into multiple clusters. To address the second issue, we propose two approaches under the EMVDG framework based on the consensus principle and the complementary principle, respectively. Specifically, we propose an EMVDG_CO method by adding a co-regularizer to enforce the cluster structures of ESVM classifiers on different views to be consistent based on the consensus principle. Inspired by multiple kernel learning, we also propose another EMVDG_MK method by fusing the ESVM classifiers from different views based on the complementary principle. In addition, we further extend our EMVDG framework to exemplar-based multi-view domain adaptation (EMVDA) framework when the unlabeled target domain data are available during the training procedure. The effectiveness of our EMVDG and EMVDA frameworks for visual recognition is clearly demonstrated by comprehensive experiments on three benchmark data sets.

Generalized Image Embedding for Multi-Domain Image Retrieval.

Learning Disentangled Representation for Cross-Modal Retrieval with Deep Mutual Information Estimation.

Domain-Specific Modeling and Semantic Alignment for Image-Based 3d Model Retrieval

Unsupervised Multi-Domain Image Translation with Domain-Specific Encoders/Decoders

Universal Model for Multi-Domain Medical Image Retrieval

Unsupervised Cross-Domain Image Retrieval with Semantic-Attended Mixture-of-Experts

WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization

Multi-level Image Representation for Large-Scale Image-Based Instance Retrieval.

Coupled Binary Embedding for Large-Scale Image Retrieval

Learning Transferable and Discriminative Representations for 2D Image-Based 3D Model Retrieval

Generalized Multi-view Embedding for Visual Recognition and Cross-modal Retrieval

Seeing the Big Picture: Deep Embedding with Contextual Evidences

Depthwise Convolution is All You Need for Learning Multiple Visual Domains

Retrieval Guided Unsupervised Multi-domain Image-to-Image Translation

Effective Image Retrieval Via Multilinear Multi-index Fusion.

Multi-view Domain Generalization for Visual Recognition

Multi-mapping Image-to-Image Translation Via Learning Disentanglement.

Fully Unsupervised Domain-Agnostic Image Retrieval

An Exemplar-Based Multi-View Domain Generalization Framework for Visual Recognition.

Image-Text Embedding Learning Via Visual and Textual Semantic Reasoning.

Collaborative Index Embedding for Image Retrieval