Abstract:Zero-shot detection (ZSD) aims to locate and classify unseen objects in pictures or videos by semantic auxiliary information without additional training examples. Most of the existing ZSD methods are based on two-stage models, which achieve the detection of unseen classes by aligning object region proposals with semantic embeddings. However, these methods have several limitations, including poor region proposals for unseen classes, lack of consideration of semantic representations of unseen classes or their inter-class correlations, and domain bias towards seen classes, which can degrade overall performance. To address these issues, the Trans-ZSD framework is proposed, which is a transformer-based multi-scale contextual detection framework that explicitly exploits inter-class correlations between seen and unseen classes and optimizes feature distribution to learn discriminative features. Trans-ZSD is a single-stage approach that skips proposal generation and performs detection directly, allowing the encoding of long-term dependencies at multiple scales to learn contextual features while requiring fewer inductive biases. Trans-ZSD also introduces a foreground-background separation branch to alleviate the confusion of unseen classes and backgrounds, contrastive learning to learn inter-class uniqueness and reduce misclassification between similar classes, and explicit inter-class commonality learning to facilitate generalization between related classes. Trans-ZSD addresses the domain bias problem in end-to-end generalized zero-shot detection (GZSD) models by using balance loss to maximize response consistency between seen and unseen predictions, ensuring that the model does not bias towards seen classes. The Trans-ZSD framework is evaluated on the PASCAL VOC and MS COCO datasets, demonstrating significant improvements over existing ZSD models.

PTMNet: Pixel-Text Matching Network for Zero-Shot Anomaly Detection

CLIP-AD: A Language-Guided Staged Dual-Path Model for Zero-shot Anomaly Detection

WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation

Dual-Image Enhanced CLIP for Zero-Shot Anomaly Detection

AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection

Random Word Data Augmentation with CLIP for Zero-Shot Anomaly Detection

TagCLIP: Improving Discrimination Ability of Zero-Shot Semantic Segmentation

Towards Zero-shot Point Cloud Anomaly Detection: A Multi-View Projection Framework

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detection

Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection

Mining Fine-Grained Image-Text Alignment for Zero-Shot Captioning via Text-Only Training

FADE: Few-shot/zero-shot Anomaly Detection Engine using Large Vision-Language Model

MuSc: Zero-Shot Industrial Anomaly Classification and Segmentation with Mutual Scoring of the Unlabeled Images

Text Augmented Spatial-aware Zero-shot Referring Image Segmentation

Anomaly Detection by Adapting a pre-trained Vision Language Model

A Prototype-Based Neural Network for Image Anomaly Detection and Localization

Learning Mask-aware CLIP Representations for Zero-Shot Segmentation

AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection