Abstract:The Unsupervised Domain Adaptation (UDA) methods aim to enhance feature transferability possibly at the expense of feature discriminability. Recently, contrastive representation learning has been applied to UDA as a promising approach. One way is to combine the mainstream domain adaptation method with contrastive self-supervised tasks. The other way uses contrastive learning to align class-conditional distributions according to the semantic structure information of source and target domains. Nevertheless, there are some limitations in two aspects. One is that optimal solutions for the contrastive self-supervised learning and the domain discrepancy minimization may not be consistent. The other is that contrastive learning uses pseudo label information of target domain to align class-conditional distributions, where the pseudo label information contains noise such that false positive and negative pairs would deteriorate the performance of contrastive learning. To address these issues, we propose Noise-robust cross-domain Contrastive Learning (NaCL) to directly realize the domain adaptation task via simultaneously learning the instance-wise discrimination and encoding semantic structures in intra- and inter-domain to the learned representation space. More specifically, we adopt topology-based selection on the target domain to detect and remove false positive and negative pairs in contrastive loss. Theoretically, we demonstrate that not only NaCL can be considered an example of Expectation Maximization (EM), but also accurate pseudo label information is beneficial for reducing the expected error on target domain. NaCL obtains superior results on three public benchmarks. Further, NaCL can also be applied to semi-supervised domain adaptation with only minor modifications, achieving advanced diagnostic performance on COVID-19 dataset. Code is available at https://github.com/jingzhengli/NaCL

ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstruction

Encoder-Decoder Contrast for Unsupervised Anomaly Detection in Medical Images.

A Novel Contrastive Learning Framework for Self-Supervised Anomaly Detection

Domain Contrast for Domain Adaptive Object Detection

Transformer-based contrastive learning framework for image anomaly detection

Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection

Abnormal Event Detection Using Deep Contrastive Learning for Intelligent Video Surveillance System

Category Contrast for Unsupervised Domain Adaptation in Visual Tasks

PatchCL-AE: Anomaly detection for medical images using patch-wise contrastive learning-based auto-encoder

Contrastive Attention for Video Anomaly Detection

Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining

Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detection

Context Enhancement with Reconstruction as Sequence for Unified Unsupervised Anomaly Detection

Contrast and Clustering: Learning Neighborhood Pair Representation for Source-free Domain Adaptation

Self-degraded contrastive domain adaptation for industrial fault diagnosis with bi-imbalanced data

P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding

NaCL: noise-robust cross-domain contrastive learning for unsupervised domain adaptation

UAC-AD: Unsupervised Adversarial Contrastive Learning for Anomaly Detection on Multi-modal Data in Microservice Systems

InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation

Deep Feature Contrasting for Industrial Image Anomaly Segmentation

CoRe: Contrastive and Restorative Self-Supervised Learning for Surface Defect Inspection