Heterogeneous Image Classification with Multi-Stage Conditional Adversarial Domain Adaptation Between SAR and Optical Imagery

Chenxuan Li,Weiwei Guo,Zenghui Zhang,Wenxian Yu
DOI: https://doi.org/10.1109/igarss46834.2022.9883912
2022-01-01
Abstract:In this paper, we deal with the problem of heterogeneous image classifiers transferring between SAR and optical im-agery through a novel multi-stage domain adaptation technique. The problem of transferring the optical image classifier to SAR and vice-versa is of practical importance because it allows us to leverage plenty of labelled data in the source do-main for the target domain task, but gains little attention. Be-cause there is a drastic distribution-gap between both the opti-cal and SAR imaging modalities, it is non-trivial to apply do-main adaption directly. We propose a multi-stage adversarial feature alignment procedure that firstly performs global ad-versarial feature alignment and then a class-conditional adver-sarial feature alignment is conducted to further enable class-discriminative feature adaption. The proposed method is val-idated on the SEN12MS dataset, and some discussions are provided about heterogeneous domain adaption between SAR and optical imagery.
What problem does this paper attempt to address?