Abstract:Automatic building detection from remote sensing images holds significant applications in various domains, including cartography, land-use change detection, urban planning, and 3D intelligent city construction. Driven by the innovation of deep learning technology, convolutional neural networks (CNNs) have emerged as a powerful framework for automatic interpretation, exhibiting hierarchical feature generation and robust representation for building extraction. However, the inherent computational limitations of convolutional operators hinder the acquisition of an effective global receptive field. Recent advancements in deep learning have witnessed the adoption of the multi-head self-attention (MHSA) mechanism by Transformer, presenting the superiority of global context construction. Nonetheless, this network structure encounters difficulties in effectively modelling two-dimensional spatial structure features with scale variation in semantic segmentation and often has huge parameters with high algorithm complexity. To address the above problems, this paper proposed a hybrid deep neural network synergistically harnessing the superiority of CNN and Transformer to extract buildings from remote sensing images. Meanwhile, an improved MHSA mechanism is developed to facilitate the construction of multiscale global representations, concurrently reducing computational complexity. Furthermore, the cross-level MHSA modules the semantic correlation between the deep and shallow-level features to refine spatial fine-grained information. The proposed method was comprehensively evaluated on two building datasets via quantitative analysis and visualization. The experimental results confirmed that the developed network and modules outperform other state-of-the-art methods and can effectively improve the accuracy (93.4% F1-score on the WHU dataset, 89.38% F1-score on the CAMB dataset) with high efficiency for building extraction.

Lightweight Hybrid CNN-ELM Model for Multi-building and Multi-floor Classification

Hierarchical Multi-Building And Multi-Floor Indoor Localization Based On Recurrent Neural Networks

Towards Accelerated Localization Performance Across Indoor Positioning Datasets

A scalable deep neural network architecture for multi-building and multi-floor indoor localization based on Wi-Fi fingerprinting

CNNLoc: Deep-Learning Based Indoor Localization with WiFi Fingerprinting

Hybrid Wireless Fingerprint Indoor Localization Method Based on a Convolutional Neural Network

ELMAENet: A Simple, Effective and Fast Deep Architecture for Image Classification

WiFiNet: WiFi-based indoor localisation using CNNs

A Floor Distinction Method Based on Recurrent Neural Network in Cellular Network

Multi-Floor Indoor Localization Based on Multi-Modal Sensors

BUILDING SECTION INSTANCE SEGMENTATION WITH COMBINED CLASSICAL AND DEEP LEARNING METHODS

Federated Learning based Hierarchical 3D Indoor Localization

Hierarchical Stage-Wise Training of Linked Deep Neural Networks for Multi-Building and Multi-Floor Indoor Localization Based on Wi-Fi RSSI Fingerprinting

A Lightweight Neural Network for Loop Closure Detection in Indoor Visual SLAM

Deep Learning for Detecting Building Defects Using Convolutional Neural Networks

Large-Scale Location-Aware Services in Access: Hierarchical Building/Floor Classification and Location Estimation using Wi-Fi Fingerprinting Based on Deep Neural Networks

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

Indoor Localization With an Autoencoder-Based Convolutional Neural Network

Classification of residential and non-residential buildings based on satellite data using deep learning

Extracting Buildings from Remote Sensing Images Using a Multitask Encoder-Decoder Network with Boundary Refinement

Building instance classification using street view images