Abstract:Deep learning algorithms have obtained great success in semantic segmentation of very high-resolution (VHR) remote sensing images. Nevertheless, training these models generally requires a large amount of accurate pixel-wise annotations, which is very laborious and time-consuming to collect. To reduce the annotation burden, this paper proposes a consistency-regularized region-growing network (CRGNet) to achieve semantic segmentation of VHR remote sensing images with point-level annotations. The key idea of CRGNet is to iteratively select unlabeled pixels with high confidence to expand the annotated area from the original sparse points. However, since there may exist some errors and noises in the expanded annotations, directly learning from them may mislead the training of the network. To this end, we further propose the consistency regularization strategy, where a base classifier and an expanded classifier are employed. Specifically, the base classifier is supervised by the original sparse annotations, while the expanded classifier aims to learn from the expanded annotations generated by the base classifier with the region-growing mechanism. The consistency regularization is thereby achieved by minimizing the discrepancy between the predictions from both the base and the expanded classifiers. We find such a simple regularization strategy is yet very useful to control the quality of the region-growing mechanism. Extensive experiments on two benchmark datasets demonstrate that the proposed CRGNet significantly outperforms the existing state-of-the-art methods. Codes and pre-trained models are available online (https://github.com/YonghaoXu/CRGNet).

Semantic Segmentation Refinement by Monte Carlo Region Growing of High Confidence Detections

Probabilistic Semantic Segmentation Refinement by Monte Carlo Region Growing

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Semantic Segmentation Via Structured Patch Prediction, Context Crf And Guidance Crf

Improving Image Segmentation with Boundary Patch Refinement

SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Process

RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements

Sparse Refinement for Efficient High-Resolution Semantic Segmentation

Semantics-Aware Dynamic Localization and Refinement for Referring Image Segmentation

Semi-Supervised Semantic Segmentation via Marginal Contextual Information

Better Image Segmentation by Exploiting Dense Semantic Predictions

Discriminative Features Reconstruction Network For Semantic Segmentation

A feature refinement module for light-weight semantic segmentation network

Context-Guided Spatial Feature Reconstruction for Efficient Semantic Segmentation

Semantic Segmentation with Multi-Path Refinement and Pyramid Pooling Dilated-Resnet.

Consistency-Regularized Region-Growing Network for Semantic Segmentation of Urban Scenes With Point-Level Annotations

Weakly Supervised Semantic Segmentation by Iterative Superpixel-CRF Refinement with Initial Clues Guiding

Boosting Interactive Image Segmentation by Exploiting Semantic Clues.

Semisupervised Semantic Segmentation by Improving Prediction Confidence