Abstract:Land cover classification is one of the most fundamental tasks in the field of remote sensing. In recent years, fully supervised fully convolutional network (FCN)-based semantic segmentation models have achieved state-of-the-art performance in the semantic segmentation task. However, creating pixel-level annotations is prohibitively expensive and laborious, especially when dealing with remote sensing images. Weakly supervised learning methods from weakly labeled annotations can overcome this difficulty to some extent and achieve impressive segmentation results, but results are limited in accuracy. Inspired by point supervision and the traditional segmentation method of seeded region growing (SRG) algorithm, a weakly towards strongly (WTS) supervised learning framework is proposed in this study for remote sensing land cover classification to handle the absence of well-labeled and abundant pixel-level annotations when using segmentation models. In this framework, only several points with true class labels are required as the training set, which are much less expensive to acquire compared with pixel-level annotations through field survey or visual interpretation using high-resolution images. Firstly, they are used to train a Support Vector Machine (SVM) classifier. Once fully trained, the SVM is used to generate the initial seeded pixel-level training set, in which only the pixels with high confidence are assigned with class labels whereas others are unlabeled. They are used to weakly train the segmentation model. Then, the seeded region growing module and fully connected Conditional Random Fields (CRFs) are used to iteratively update the seeded pixel-level training set for progressively increasing pixel-level supervision of the segmentation model. Sentinel-2 remote sensing images are used to validate the proposed framework, and SVM is selected for comparison. In addition, FROM-GLC10 global land cover map is used as training reference to directly train the segmentation model. Experimental results show that the proposed framework outperforms other methods and can be highly recommended for land cover classification tasks when the pixel-level labeled datasets are insufficient by using segmentation models.

Semantic Annotation of High-Resolution Satellite Images Via Weakly Supervised Learning.

Semantic Annotation of Satellite Images Via Joint Multi-Feature Learning with Diversity Constraint.

Weakly Supervised Semantic Segmentation of Satellite Images

Semantic segmentation of high-resolution satellite images using deep learning

Semantic Segmentation of Weakly Annotated Remote Sensing Images Based on Feature Adversary and Uncertainty Perception

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

On the Effectiveness of Weakly Supervised Semantic Segmentation for Building Extraction From High-Resolution Remote Sensing Imagery

Active Learning for Improved Semi-Supervised Semantic Segmentation in Satellite Images

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Superpixel Consistency Saliency Map Generation for Weakly Supervised Semantic Segmentation of Remote Sensing Images

One model is enough: Toward multiclass weakly supervised remote sensing image semantic segmentation

WTS: A Weakly towards Strongly Supervised Learning Framework for Remote Sensing Land Cover Classification Using Segmentation Models

Assisted learning for land use classification: The important role of semantic correlation between heterogeneous images

Weakly Supervised Semantic Segmentation of Remote Sensing Images Based on Progressive Mining and Saliency-Enhanced Self-Attention

Large-Scale Land Cover Mapping with Fine-Grained Classes Via Class-Aware Semi-Supervised Semantic Segmentation

Semi-Supervised Deep learning via Transformation Consistency Regularization for Remote Sensing Image Semantic Segmentation

Low-Shot Learning for the Semantic Segmentation of Remote Sensing Imagery

Weakly Supervised Semantic Segmentation in Aerial Imagery via Explicit Pixel-Level Constraints

Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning

Automatic Weakly Supervised Object Detection from High Spatial Resolution Remote Sensing Images Via Dynamic Curriculum Learning

Semi-automatic Annotation Method for Semantic Segmentation of Synthetic Aperture Radar Images