Abstract:In this paper, we focus on tackling the problem of automatic semantic annotation of high resolution (HR) optical satellite images, which aims to assign one or several predefined semantic concepts to an image according to its content. The main challenges arise from the difficulty of characterizing complex and ambiguous contents of the satellite images and the high human labor cost caused by preparing a large amount of training examples with high-quality pixel-level labels in fully supervised annotation methods. To address these challenges, we propose a unified annotation framework by combining discriminative high-level feature learning and weakly supervised feature transferring. Specifically, an efficient stacked discriminative sparse autoencoder (SDSAE) is first proposed to learn high-level features on an auxiliary satellite image data set for the land-use classification task. Inspired by the motivation that the encoder of the prelearned SDSAE can be regarded as a generic high-level feature extractor for HR optical satellite images, we then transfer the learned high-level features to semantic annotation. To compensate the difference between the auxiliary data set and the annotation data set, the transferred high-level features are further fine-tuned in a weakly supervised scheme by using the tile-level annotated training data. Finally, the fine-tuning process is formulated as an ultimate optimization problem, which can be solved efficiently with our proposed alternate iterative optimization method. Comprehensive experiments on a publicly available land-use classification data set and an annotation data set demonstrate the superiority of our SDSAE-based high-level feature learning method and the effectiveness of our weakly supervised semantic annotation framework compared with state-of-the-art fully supervised annotation methods.

Unsupervised Super-Resolution of Satellite Imagery for High Fidelity Material Label Transfer

An Unsupervised Domain Adaptation Method for Multi-Modal Remote Sensing Image Classification

Domain Adaptable Self-supervised Representation Learning on Remote Sensing Satellite Imagery

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Unsupervised Domain Adaption for High-Resolution Coastal Land Cover Mapping with Category-Space Constrained Adversarial Network

Semantic Annotation of High-Resolution Satellite Images Via Weakly Supervised Learning.

Unsupervised Urban Scene Segmentation Via Domain Adaptation

Decomposition-Based Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

Unsupervised Satellite Image Classification Based on Partial Transfer Learning

Robust Remote Sensing Scene Interpretation Based on Unsupervised Domain Adaptation

Unsupervised domain adaptation and super resolution on drone images for autonomous dry herbage biomass estimation

Unsupervised Mixed Multi-Target Domain Adaptation for Remote Sensing Images Classification

Unsupervised Transfer Learning Using For Multi-Model Remote Sensing Data Classification

High-resolution semantically-consistent image-to-image translation

Unsupervised Domain Adaptation for Semantic Segmentation of High-resolution Remote Sensing Imagery Driven by Category-Certainty Attention

Unsupervised Adversarial Domain Adaptation for Agricultural Land Extraction of Remote Sensing Images

Self-Supervised Pretraining on Satellite Imagery: a Case Study on Label-Efficient Vehicle Detection

Unsupervised Learning for Real-World Super-Resolution

Multilevel Unsupervised Domain Adaptation for Single-Stage Object Detection in Remote Sensing Images

Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation