Rendering-Inspired Cross-Source Feature Disentanglement for Domain Adaptation- Based SAR Ship Classification

Haonan Zhang,Yafei Lv,Jianting Zhang,Qian Wu,Zaidao Wen
DOI: https://doi.org/10.1109/lgrs.2024.3388384
IF: 5.343
2024-04-27
IEEE Geoscience and Remote Sensing Letters
Abstract:This letter presents a novel generative model-based domain adaptation framework for synthetic aperture radar (SAR) ship classification. The framework introduces a unified image representation model tailored for multiple sensor observations, without distinguishing between the source and target domains. Two types of feature encoders are designed, leveraging domain-level and category-level supervised signals to extract ship- and source-specific factors. The letter elaborates on a novel conditional rendering-inspired imaging function that utilizes a conditional convolutional neural network (CNN) and the adaptive instance normalization (AdaIN) module to simulate the interaction effects between rays and the ship in the image rendering algorithm. By modulating both appearance and statistics, the imaging function captures textural distinctions and statistical variances between SAR and optical images in a physically plausible way. Furthermore, we develop an efficient intervention-based regularization strategy for feature disentanglement through a category source dual-aware discriminators module. The effectiveness of the proposed model is demonstrated through experimental results on the FUSAR-Ship dataset, assisted with optical ship images from FGSCR42. Comparative analysis with other domain adaptation algorithms and several typical deep classification architectures demonstrates the superior classification accuracy achieved by our model.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?