Abstract:In target recognition, the information about the target usually exists in several domains captured by different sources (sensors). However, it is difficult for us to obtain the perfect target information as the source domain data due to the sensors' limitations sometimes. For the target classification of visible and infrared paired images, we assume that some classes of visible and infrared paired images and other classes of visible images can be obtained, whereas other classes of unseen infrared images need to be classified. This problem is actually a zero-shot deep domain adaptation (ZDDA) problem which divides the data into task-relevant (T-R) data and task-irrelevant (T-I) data. Moreover, the classes of T-R data require recognition, while the classes of T-I data do not need. The traditional ZDDA method sacrifices the classification accuracy of T-R data in the target domain for the generalization ability of T-I data in the source domain. So we propose a method to solve the problem in another way. More precisely, we first use the image-to-image translation network to learn the mapping between the source domain (visible images) T-I data and the target domain (infrared images) T-I data, and convert the visible T-R images to pseudo-infrared images. Then the pseudo-infrared images and the inverted grayscale T-R images are combined to construct a new hybrid domain (source domain I). Meanwhile, we also construct a hybrid domain (source domain II) of T-I images similarly. Besides, we use the infrared TI images to construct the third domain (source domain III). Finally, we design a deep domain generalization method for cross-domain infrared image classification. And the total loss consists of the classification loss of the source domain I and the distribution alignment loss between the source domains II and III. We evaluate our method using VAIS ship and RGB-NIR scene datasets. The experimental results demonstrate the effectiveness of the proposed method.

Cross-Domain Infrared Image Classification via Image-to-Image Translation and Deep Domain Generalization

Domain Adaptation for Infrared-Radar Cross-Scene Multimodal Detection

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Domain‐invariant Attention Network for Transfer Learning Between Cross‐scene Hyperspectral Images

Infrared colorization with cross-modality zero-shot learning

Cross-Domain Hyperspectral Image Classification Based on Transformer

Infrared Small-Sample Target Recognition with Content-focused Domain Adaption Network

Cross-domain Residual Deep NMF for Transfer Learning Between Different Hyperspectral Image Scenes.

Cross-Domain Identification for Thermal-to-Visible Face Recognition

Supervised Image Translation from Visible to Infrared Domain for Object Detection

Improving the Generalization Ability of Deep Neural Networks for Cross-Domain Visual Recognition

Hybrid Cross Deep Network for Domain Adaptation and Energy Saving in Visual Internet of Things.

Discriminative Transfer Feature and Label Consistency for Cross-Domain Image Classification.

Two-Stage Domain Alignment Single-Source Domain Generalization Network for Cross-Scene Hyperspectral Images Classification

Multisource Collaborative Domain Generalization for Cross-Scene Remote Sensing Image Classification

A General Transitive Transfer Learning Framework for Cross-Optical Sensor Remote Sensing Image Scene Understanding

Cross-Modal Cross-Domain Dual Alignment Network for RGB-Infrared Person Re-Identification

A Semantic Domain Adaption Framework for Cross-Domain Infrared Small Target Detection

Enhanced Cross-Domain Dim and Small Infrared Target Detection via Content-Decoupled Feature Alignment

Cross-Domain Co-Occurring Feature for Visible-Infrared Image Matching.

Multisource Domain Generalization Two-Branch Network for Hyperspectral Image Cross-Domain Classification