Abstract:Automatic extraction of building footprints from images is one of the vital means for obtaining building footprint data. However, due to the varied appearances, scales, and intricate structures of buildings, this task still remains challenging. Recently, the vision transformer (ViT) has exhibited significant promise in semantic segmentation, thanks to its efficient capability in obtaining long-range dependencies. This article employs the ViT for extracting building footprints. Yet, utilizing ViT often encounters limitations: extensive computational costs and insufficient preservation of local details in the process of extracting features. To address these challenges, a network based on an enhanced ViT (EViT) is proposed. In this network, one convolutional neural network (CNN)-based branch is introduced to extract comprehensive spatial details. Another branch, consisting of several multiscale enhanced ViT (EV) blocks, is developed to capture global dependencies. Subsequently, a multiscale and enhanced boundary feature extraction block is developed to fuse global dependencies and local details and perform boundary features enhancement, thereby yielding multiscale global-local contextual information with enhanced boundary feature. Specifically, we present a window-based cascaded multihead self-attention (W-CMSA) mechanism, characterized by linear complexity in relation to the window size, which not only reduces computational costs but also enhances attention diversity. The EViT has undergone comprehensive evaluation alongside other state-of-the-art (SOTA) approaches using three benchmark datasets. The findings illustrate that EViT exhibits promising performance in extracting building footprints and surpasses SOTA approaches. Specifically, it achieved 82.45%, 91.76%, and 77.14% IoU on the SpaceNet, WHU, and Massachusetts datasets, respectively. The implementation of EViT is available at https://github.com/dh609/EViT.

Visual Estimation of Building Condition with Patch-level ConvNets

Deep Learning for Detecting Building Defects Using Convolutional Neural Networks

Vision-based real estate price estimation

Visual Perception of Building and Household Vulnerability from Streets

House price estimation from visual and textual features

PADENet: an Efficient and Robust Panoramic Monocular Depth Estimation Network for Outdoor Scenes.

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Vision-based Structural Inspection using Multiscale Deep Convolutional Neural Networks

Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

Image Based Appraisal of Real Estate Properties

Exploiting Semantic Scene Reconstruction for Estimating Building Envelope Characteristics

Extracting Building Footprint From Remote Sensing Images by an Enhanced Vision Transformer Network

Estimation of wind pressure field on low-rise buildings based on a novel conditional neural network

Computer vision-based cascade detection of peeling and cracking in masonry house walls

Real Estate Property Valuation using Self-Supervised Vision Transformers

Automatic Building Age Prediction from Street View Images

Automated crack segmentation in close-range building façade inspection images using deep learning techniques

Urban building extraction from high-resolution remote sensing imagery based on multi-scale recurrent conditional generative adversarial network

Towards Automated Post-Earthquake Inspections with Deep Learning-based Condition-Aware Models

Depth-Enhanced Feature Pyramid Network for Occlusion-Aware Verification of Buildings from Oblique Images