Abstract:In this paper, we focus on tackling the problem of automatic semantic annotation of high resolution (HR) optical satellite images, which aims to assign one or several predefined semantic concepts to an image according to its content. The main challenges arise from the difficulty of characterizing complex and ambiguous contents of the satellite images and the high human labor cost caused by preparing a large amount of training examples with high-quality pixel-level labels in fully supervised annotation methods. To address these challenges, we propose a unified annotation framework by combining discriminative high-level feature learning and weakly supervised feature transferring. Specifically, an efficient stacked discriminative sparse autoencoder (SDSAE) is first proposed to learn high-level features on an auxiliary satellite image data set for the land-use classification task. Inspired by the motivation that the encoder of the prelearned SDSAE can be regarded as a generic high-level feature extractor for HR optical satellite images, we then transfer the learned high-level features to semantic annotation. To compensate the difference between the auxiliary data set and the annotation data set, the transferred high-level features are further fine-tuned in a weakly supervised scheme by using the tile-level annotated training data. Finally, the fine-tuning process is formulated as an ultimate optimization problem, which can be solved efficiently with our proposed alternate iterative optimization method. Comprehensive experiments on a publicly available land-use classification data set and an annotation data set demonstrate the superiority of our SDSAE-based high-level feature learning method and the effectiveness of our weakly supervised semantic annotation framework compared with state-of-the-art fully supervised annotation methods.

Semi- and weak-supervised learning for Norwegian tree species detection

Lidar-based Norwegian tree species detection using deep learning

Weakly Supervised Semantic Segmentation of Remote Sensing Images for Tree Species Classification Based on Explanation Methods

Automated feature-specific tree species identification from natural images using deep semi-supervised learning

Training Deep Learning Algorithms on Synthetic Forest Images for Tree Detection

Sentinel-1 SAR Based Weakly Supervised Learning For Tropical Forest Mapping

Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning

The Impact of Semi-Supervised Learning on Line Segment Detection

Semi-supervised remote sensing image scene classification with prototype-based consistency

DiverseNet: Decision Diversified Semi-supervised Semantic Segmentation Networks for Remote Sensing Imagery

Deep learning for semantic segmentation of remote sensing images with rich spectral content

Tree species classification at the pixel-level using deep learning and multispectral time series in an imbalanced context

Semi-Supervised Semantic Segmentation in Earth Observation: The MiniFrance Suite, Dataset Analysis and Multi-task Network Study

Country-wide Retrieval of Forest Structure From Optical and SAR Satellite Imagery With Deep Ensembles

Semantic Annotation of High-Resolution Satellite Images Via Weakly Supervised Learning.

Tree Detection and Diameter Estimation Based on Deep Learning

PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Active Learning for Improved Semi-Supervised Semantic Segmentation in Satellite Images

Individual Tree-Crown Detection and Species Identification in Heterogeneous Forests Using Aerial RGB Imagery and Deep Learning

Robust Semisupervised Land-Use Classification Using Remote Sensing Data With Weak Labels