Abstract:Zero-shot image recognition attempts to simulate the zero-shot learning mechanism of humans and recognizes the images of novel classes. It is crucial to learn transferable knowledge from seen classes and generalize it to unseen classes for image recognition in zero-shot learning (ZSL). Most existing ZSL methods extract visual features with pretrained backbone networks and learn transferable knowledge with the extracted visual features. However, the backbone networks are not pretrained for a special task, and the extracted visual features usually contain some distractive information for the ZSL task, which causes some discriminative information to be ignored or weakened and degrades the quality of knowledge learned from seen classes. Moreover, since visual samples of unseen classes are not obtainable, domain shift is another challenging problem. In this paper, we propose visual feature enhancement to learn more discriminative visual features via a graph convolutional network (GCN) and an attention mechanism for improving the quality of the learned transferable knowledge. Different from previous works, we explore the correlations between different latent visual patterns of an image and introduce GCN to enhance visual features. On the other hand, we take advantage of different learning mechanisms of GCN and MLP and propose dual classifier learning for improving the generalization and inference capabilities of our model. In end-to-end model training, the module of visual feature enhancement and the module of dual classifier learning are beneficial to each other via joint optimization. Finally, we perform extensive experiments in the ZSL setting and GZSL setting. The extensive experimental results verify the effectiveness and superiority of our method.

Fabric Recognition Using Zero-Shot Learning

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Multimodal zero-shot learning for tactile texture recognition

Tactile-Based Fabric Defect Detection Using Convolutional Neural Network With Attention Mechanism

Deep Learning for Surface Material Classification Using Haptic And Visual Information

Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Texture recognition based on magnetostrictive tactile sensor array and convolutional neural network

A Machine Vision-based Fabric Defect Detection Solution for Textile Production Industry Using Object Detection

Fabric surface characterization: assessment of deep learning-based texture representations using a challenging dataset

Learning a Deep Embedding Model for Zero-Shot Learning

Surface Recognition With a Tactile Finger Based on Automatic Features Transferred From Deep Learning

Fab-ME: A Vision State-Space and Attention-Enhanced Framework for Fabric Defect Detection

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Transductive Zero-Shot Learning With Adaptive Structural Embedding

ZeroMamba: Exploring Visual State Space Model for Zero-Shot Learning

CHANNEL-WISE MIX-FUSION DEEP NEURAL NETWORKS FOR ZERO-SHOT LEARNING

Multi-modal zero-shot dynamic hand gesture recognition

Learning Latent Semantic Attributes for Zero-Shot Object Detection.

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Cross-Modal Zero-Shot-Learning for Tactile Object Recognition