Abstract:Automatic extraction of building footprints from images is one of the vital means for obtaining building footprint data. However, due to the varied appearances, scales, and intricate structures of buildings, this task still remains challenging. Recently, the vision transformer (ViT) has exhibited significant promise in semantic segmentation, thanks to its efficient capability in obtaining long-range dependencies. This article employs the ViT for extracting building footprints. Yet, utilizing ViT often encounters limitations: extensive computational costs and insufficient preservation of local details in the process of extracting features. To address these challenges, a network based on an enhanced ViT (EViT) is proposed. In this network, one convolutional neural network (CNN)-based branch is introduced to extract comprehensive spatial details. Another branch, consisting of several multiscale enhanced ViT (EV) blocks, is developed to capture global dependencies. Subsequently, a multiscale and enhanced boundary feature extraction block is developed to fuse global dependencies and local details and perform boundary features enhancement, thereby yielding multiscale global-local contextual information with enhanced boundary feature. Specifically, we present a window-based cascaded multihead self-attention (W-CMSA) mechanism, characterized by linear complexity in relation to the window size, which not only reduces computational costs but also enhances attention diversity. The EViT has undergone comprehensive evaluation alongside other state-of-the-art (SOTA) approaches using three benchmark datasets. The findings illustrate that EViT exhibits promising performance in extracting building footprints and surpasses SOTA approaches. Specifically, it achieved 82.45%, 91.76%, and 77.14% IoU on the SpaceNet, WHU, and Massachusetts datasets, respectively. The implementation of EViT is available at https://github.com/dh609/EViT.

Hybrid Feature Embedding For Automatic Building Outline Extraction

Dual-Tasks Siamese Transformer Framework for Building Damage Assessment

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

Hybrid Attention Cascaded U-net for Building Extraction from Aerial Images

Building Outline Extraction Directly Using the U2-Net Semantic Segmentation Model from High-Resolution Aerial Images and a Comparison Study

Vectorized Building Extraction from High-Resolution Remote Sensing Images Using Spatial Cognitive Graph Convolution Model

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

A Dual-Branch Fusion Network Based on Reconstructed Transformer for Building Extraction in Remote Sensing Imagery

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

STransU2Net: Transformer based hybrid model for building segmentation in detailed satellite imagery

Building Outline Delineation From VHR Remote Sensing Images Using the Convolutional Recurrent Neural Network Embedded With Line Segment Information

A Cascaded Network With Coupled High-Low Frequency Features for Building Extraction

Hierarchical Disentangling Network for Building Extraction from Very High Resolution Optical Remote Sensing Imagery

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

Extracting Building Footprint From Remote Sensing Images by an Enhanced Vision Transformer Network

Learn to Extract Building Outline from Misaligned Annotation through Nearest Feature Selector

DCTNET: HYBRID NETWORK MODEL FUSING WITH MULTISCALE DEFORMABLE CNN AND TRANSFORMER STRUCTURE FOR ROAD EXTRACTION FROM GAOFEN SATELLITE REMOTE SENSING IMAGE

Building Extraction With Vision Transformer

Hybrid transformer-CNN networks using superpixel segmentation for remote sensing building change detection

BUILDING OUTLINE EXTRACTION FROM AERIAL IMAGES USING CONVOLUTIONAL NEURAL NETWORKS

Crop field extraction from high resolution remote sensing images based on semantic edges and spatial structure map