Abstract:Weakly supervised building extraction methods, utilizing image-level labels, offer a cost-effective solution by significantly reducing the need for pixel-level annotation in high-resolution (HR) remote sensing (RS) images. These methods often focus on class activation map (CAM) optimization based on features extracted from individual images, missing out on the benefits of associating building features from multiple RS images (i.e., n images) to improve CAMs. This limitation leaves room for improvement in both CAM optimization and pseudo-mask generation. To address this, we propose the building-aware clustering and activation refinement network (BAC-AR-Net), a novel weakly supervised network to enhance weakly supervised building extraction performance. The building-aware clustering (BAC) module aggregates and clusters feature maps from multiple building samples to obtain common features of buildings. The common features are subsequently used to extract regions with similar building semantics, thereby enhancing the accuracy and completeness of building coverage in CAMs. Additionally, the activation refinement module is designed to generate pseudo-masks with clear boundaries and an effective separation of buildings and background. Experiments were conducted on the ISPRS Potsdam and Vaihingen datasets as well as a self-built building dataset to verify the effectiveness of our proposed method. The results show the proposed method outperforms both the weakly supervised semantic segmentation and weakly supervised building extraction methods that use image-level labels, achieving IoU accuracies of 0.8556, 0.8163, and 0.7797 on the respective datasets. This study introduces a novel weakly supervised learning framework to the RS application, with a particular focus on building extraction and semantic segmentation tasks.

ARE-Net: An Improved Interactive Model for Accurate Building Extraction in High-Resolution Remote Sensing Imagery

Arc-Net: An Efficient Network For Building Extraction From High-Resolution Aerial Images

BEARNet: A Novel Buildings Edge-Aware Refined Network for Building Extraction from High-Resolution Remote Sensing Images.

CSA-Net: Complex Scenarios Adaptive Network for Building Extraction for Remote Sensing Images

EA U2-Net: An Efficient Building Extraction Algorithm Based on Complex Background Information

HA U-Net: Improved Model for Building Extraction From High Resolution Remote Sensing Imagery

ReA-Net: A Multiscale Region Attention Network With Neighborhood Consistency Supervision for Building Extraction From Remote Sensing Image

Building Extraction From Very High-Resolution Remote Sensing Images Using Refine-UNet

EU-Net: an Efficient Fully Convolutional Network for Building Extraction from Optical Remote Sensing Images.

Automatic Building Extraction on High-Resolution Remote Sensing Imagery Using Deep Convolutional Encoder-Decoder with Spatial Pyramid Pooling.

Building NAS: Automatic Designation of Efficient Neural Architectures for Building Extraction in High-Resolution Aerial Images.

BRRNet: A Fully Convolutional Neural Network for Automatic Building Extraction From High-Resolution Remote Sensing Images

Multi-Scale Attention Network for Building Extraction from High-Resolution Remote Sensing Images

A Building Extraction Method for High-Resolution Remote Sensing Images with Multiple Attentions and Parallel Encoders Combining Enhanced Spectral Information

Efficient Building Extraction for High Spatial Resolution Images Based on Dual Attention Network

DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image

Automatic Building Extraction from High-Resolution Aerial Imagery Via Fully Convolutional Encoder-Decoder Network with Non-Local Block

Weakly Supervised Building Extraction from High-Resolution Remote Sensing Images Based on Building-Aware Clustering and Activation Refinement Network

Building Outline Extraction Directly Using the U2-Net Semantic Segmentation Model from High-Resolution Aerial Images and a Comparison Study

SDSNet: Building Extraction in High-Resolution Remote Sensing Images Using a Deep Convolutional Network with Cross-Layer Feature Information Interaction Filtering

Automated Building Extraction Using Satellite Remote Sensing Imagery