Abstract:Zero-Shot Learning (ZSL) aims at classifying previously unseen class samples and has gained its popularity in applications where samples of some categories are scarce for training. The basic idea to address this issue is transferring knowledge from the seen classes to the unseen classes through mapping the visual feature to an embedding space spanned by class semantic information. The class semantic information can be obtained from human-labeled attributes or text corpus in an unsupervised fashion. Therefore, the embedding function from visual space to the embedding space is extremely important. However, the existing embedding approaches to ZSL mainly focus on aligning pairwise semantic consistency from heterogeneous spaces but ignore the intrinsic structure of the locally homogeneous isomorph. In order to preserve the locally visual structure in the embedding process, this paper proposes a Manifold regularized Cross-Modal Embedding (MCME) approach for ZSL by formulating the manifold constraint for intrinsic structure of the visual features as well as aligning pairwise consistency. The linear, closed-form solution makes MCME efficient to compute. Furthermore, rather than applying the embedding function learned from the seen classes directly, we also propose a new domain adaptation strategy to overcome the domain-shift problem during the knowledge transfer process. The MCME with the domain adaptation method is called MCME-DA. Extensive experiments on the benchmark datasets of AwA and CUB validate the superiority and promise of MCME and MCME-DA.

Cross-Modal Zero-Shot-Learning for Tactile Object Recognition

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Multimodal Zero-Shot Learning for Tactile Texture Recognition

Transductive discriminative dictionary learning approach for zero-shot classification

Dual Collaborative Visual-Semantic Mapping for Multi-Label Zero-Shot Image Recognition

Seeing By Touching: Cross-Modal Matching For Tactile And Vision Measurements

Visuo-Tactile Zero-Shot Object Recognition with Vision-Language Model

Transductive Zero-Shot Learning with a Self-Training Dictionary Approach

Zero-shot Learning with Regularized Cross-Modality Ranking.

Manifold Regularized Cross-Modal Embedding for Zero-Shot Learning

Extreme Kernel Sparse Learning for Tactile Object Recognition

Learning object-centric complementary features for zero-shot learning

Cross Knowledge-based Generative Zero-Shot Learning approach with Taxonomy Regularization

Fabric Recognition Using Zero-Shot Learning

Tactile Object Recognition Using Supervised Dictionary Learning

Learning discriminative visual semantic embedding for zero-shot recognition

Zero-Shot Recognition Using Dual Visual-Semantic Mapping Paths.

Intra-Modal Proxy Learning for Zero-Shot Visual Categorization with CLIP

Active Visual-Tactile Cross-Modal Matching.