Abstract:Although domain adaptation has been extensively studied in natural image-based segmentation task, the research on cross-domain segmentation for very high resolution (VHR) remote sensing images (RSIs) still remains underexplored. The VHR RSIs-based cross-domain segmentation mainly faces two critical challenges: 1) Large area land covers with many diverse object categories bring severe local patch-level data distribution deviations, thus yielding different adaptation difficulties for different local patches; 2) Different VHR sensor types or dynamically changing modes cause the VHR images to go through intensive data distribution differences even for the same geographical location, resulting in different global feature-level domain gap. To address these challenges, we propose a curriculum-style local-to-global cross-domain adaptation framework for the segmentation of VHR RSIs. The proposed curriculum-style adaptation performs the adaptation process in an easy-to-hard way according to the adaptation difficulties that can be obtained using an entropy-based score for each patch of the target domain, and thus well aligns the local patches in a domain image. The proposed local-to-global adaptation performs the feature alignment process from the locally semantic to globally structural feature discrepancies, and consists of a semantic-level domain classifier and an entropy-level domain classifier that can reduce the above cross-domain feature discrepancies. Extensive experiments have been conducted in various cross-domain scenarios, including geographic location variations and imaging mode variations, and the experimental results demonstrate that the proposed method can significantly boost the domain adaptability of segmentation networks for VHR RSIs. Our code is available at: <a class="link-external link-https" href="https://github.com/BOBrown/CCDA_LGFA" rel="external noopener nofollow">this https URL</a>.

Remote Sensing Image Categorization with Domain Adaptation-Based Convolution Neural Network

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Scalable domain adaptation of convolutional neural networks

Unsupervised Domain Adaptation for Semantic Segmentation of High-resolution Remote Sensing Imagery Driven by Category-Certainty Attention

Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification

High Efficient Deep Feature Extraction and Classification of Spectral-Spatial Hyperspectral Image Using Cross Domain Convolutional Neural Networks

Fully convolutional neural networks for remote sensing image classification

Evolving Convolutional Neural Network And Its Application In Fine-Grained Visual Categorization

Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level prototype memory

High-Resolution Remote Sensing Image Classification Method Based on Convolutional Neural Network and Restricted Conditional Random Field

Scene Classification Of High Resolution Remote Sensing Images Using Convolutional Neural Networks

A survey of remote sensing image classification based on CNNs

Semi-Supervised Domain Adaptation Via Convolutional Neural Network

Curriculum-style Local-to-global Adaptation for Cross-domain Remote Sensing Image Segmentation

C3DA: A Universal Domain Adaptation Method for Scene Classification From Remote Sensing Imagery

Pixel-Wise Classification Method For High Resolution Remote Sensing Imagery Using Deep Neural Networks

Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification.

Semisupervised Cross-Domain Remote Sensing Scene Classification via Category-Level Feature Alignment Network

Partial Domain Adaptation for Scene Classification From Remote Sensing Imagery

Transferring CNN With Adaptive Learning for Remote Sensing Scene Classification

An Adversarial Domain Adaptation Network for Cross-Domain Fine-Grained Recognition