Abstract:Zero-shot detection (ZSD) aims to locate and classify unseen objects in pictures or videos by semantic auxiliary information without additional training examples. Most of the existing ZSD methods are based on two-stage models, which achieve the detection of unseen classes by aligning object region proposals with semantic embeddings. However, these methods have several limitations, including poor region proposals for unseen classes, lack of consideration of semantic representations of unseen classes or their inter-class correlations, and domain bias towards seen classes, which can degrade overall performance. To address these issues, the Trans-ZSD framework is proposed, which is a transformer-based multi-scale contextual detection framework that explicitly exploits inter-class correlations between seen and unseen classes and optimizes feature distribution to learn discriminative features. Trans-ZSD is a single-stage approach that skips proposal generation and performs detection directly, allowing the encoding of long-term dependencies at multiple scales to learn contextual features while requiring fewer inductive biases. Trans-ZSD also introduces a foreground-background separation branch to alleviate the confusion of unseen classes and backgrounds, contrastive learning to learn inter-class uniqueness and reduce misclassification between similar classes, and explicit inter-class commonality learning to facilitate generalization between related classes. Trans-ZSD addresses the domain bias problem in end-to-end generalized zero-shot detection (GZSD) models by using balance loss to maximize response consistency between seen and unseen predictions, ensuring that the model does not bias towards seen classes. The Trans-ZSD framework is evaluated on the PASCAL VOC and MS COCO datasets, demonstrating significant improvements over existing ZSD models.

A Meta-Contrastive Learning with Data Augmentation Framework for Zero-Shot Stance Detection

EDDA: A Encoder-Decoder Data Augmentation Framework for Zero-Shot Stance Detection

Domain Adaptation Meets Zero-Shot Learning: an Annotation-Efficient Approach to Multi-Modality Medical Image Segmentation

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

Enhancing Zero-Shot Stance Detection with Contrastive and Prompt Learning

Commonsense-based adversarial learning framework for zero-shot stance detection

Meta-Transfer Networks for Zero-Shot Learning

Meta-ZSDETR: Zero-shot DETR with Meta-learning

Attribute-Modulated Generative Meta Learning for Zero-shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptation

Zero-shot stance detection based on multi-expert collaboration

Exploiting Sentiment and Common Sense for Zero-shot Stance Detection

Zero-Shot Stance Detection using Contextual Data Generation with LLMs

Semantics-Guided Contrastive Network for Zero-Shot Object detection

Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance

An end-to-end deep generative approach with meta-learning optimization for zero-shot object classification

The effect of media and temperature on the storage of Chlamydia trachomatis.

Zero-Shot Learning by Harnessing Adversarial Samples

Learning Latent Semantic Attributes for Zero-Shot Object Detection.