Abstract:Appearances and qualities of remote sensing images are affected by different atmospheric conditions, quality of sensors, and radiometric calibrations. This heavily challenges the generalization ability of a deep learning or other machine learning model: the performance of a model pretrained on a source remote sensing data set can significantly decrease when applied to a different target data set. The popular generative adversarial networks (GANs) can realize style or appearance transfer between a source and target data sets, which may boost the performance of a deep learning model through generating new target images similar to source samples. In this study, we comprehensively evaluate the performance of GAN-based image-level transfer methods on convolutional neural network (CNN) based image processing models that are trained on one dataset and tested on another one. Firstly, we designed the framework for the evaluation process. The framework consists of two main parts, the GAN-based image-level domain adaptation, which transfers a target image to a new image with similar probability distribution of source image space, and the CNN-based image processing tasks, which are used to test the effects of GAN-based domain adaptation. Second, the domain adaptation is implemented with two mainstream GAN methods for style transfer, the CycleGAN and the AgGAN. The image processing contains two major tasks, segmentation and object detection. The former and the latter are designed based on the widely applied U-Net and Faster R-CNN, respectively. Finally, three experiments, associated with three datasets, are designed to cover different application cases, a change detection case where temporal data is collected from the same scene, a two-city case where images are collected from different regions and a two-sensor case where images are obtained from aerial and satellite platforms respectively. Results revealed that, the GAN-based image transfer can significantly boost the performance of the segmentation model in the change detection case, however, it did not surpass conventional methods; in the other two cases, the GAN-based methods obtained worse results. In object detection, almost all the methods failed to boost the performance of the Faster R-CNN and the GAN-based methods performed the worst.

Improving Feature’s Capability of Carrying Category-specific Information for Adversarial Domain Adaptation

Trust-aware Conditional Adversarial Domain Adaptation with Feature Norm Alignment.

Training Generative Adversarial Networks in One Stage

Domain-Invariant Adversarial Learning for Unsupervised Domain Adaption.

Effective Visual Domain Adaptation via Generative Adversarial Distribution Matching

Improving the Generalization of Adversarial Training with Domain Adaptation

Hierarchical Domain Adaptation with Local Feature Patterns

Improving GANs with A Dynamic Discriminator

Cross-Domain Sentiment Classification with Attention-Assisted GAN

Improving Global Adversarial Robustness Generalization With Adversarially Trained GAN

Improving GAN Training via Feature Space Shrinkage

Generate To Adapt: Aligning Domains using Generative Adversarial Networks

Rob-GAN: Generator, Discriminator, and Adversarial Attacker

Evaluation of GAN-Based Model for Adversarial Training

Improving the Transferability of Adversarial Examples by Using Generative Adversarial Networks and Data Enhancement

C2DAN: an Improved Deep Adaptation Network with Domain Confusion and Classifier Adaptation.

Simple Yet Effective Way for Improving the Performance of GAN

Evaluating generative adversarial networks based image-level domain transfer for multi-source remote sensing image segmentation and object detection

Two-Stage Domain Alignment Single-Source Domain Generalization Network for Cross-Scene Hyperspectral Images Classification

Generative Adversarial Trainer: Defense to Adversarial Perturbations with GAN

Domain generalization based on domain-specific adversarial learning