Abstract:In the aftermath of a natural hazard, rapid and accurate building damage assessment from remote sensing imagery is crucial for disaster response and rescue operations. Although recent deep learning-based studies have made considerable improvements in assessing building damage, most state-of-the-art works focus on pixel-based, multi-stage approaches, which are more complicated and suffer from partial damage recognition issues at the building-instance level. In the meantime, it is usually time-consuming to acquire sufficient labeled samples for deep learning applications, making a conventional supervised learning pipeline with vast annotation data unsuitable in time-critical disaster cases. In this study, we present an end-to-end building damage assessment framework integrating multitask semantic segmentation with semi-supervised learning to tackle these issues. Specifically, a multitask-based Siamese network followed by object-based post-processing is first constructed to solve the semantic inconsistency problem by refining damage classification results with building extraction results. Moreover, to alleviate labeled data scarcity, a consistency regularization-based semi-supervised semantic segmentation scheme with iteratively perturbed dual mean teachers is specially designed, which can significantly reinforce the network perturbations to improve model performance while maintaining high training efficiency. Furthermore, a confidence weighting strategy is embedded into the semi-supervised pipeline to focus on convincing samples and reduce the influence of noisy pseudo-labels. The comprehensive experiments on three benchmark datasets suggest that the proposed method is competitive and effective in building damage assessment under the circumstance of insufficient labels, which offers a potential artificial intelligence-based solution to respond to the urgent need for timeliness and accuracy in disaster events.

Mbda-net: a building damage assessment model based on a multi-scale fusion network

BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images

Post-disaster building damage assessment based on improved U-Net

Deep object segmentation and classification networks for building damage detection using the xBD dataset

Dual-Tasks Siamese Transformer Framework for Building Damage Assessment

Building Damage Detection Using U-Net with Attention Mechanism from Pre- and Post-Disaster Remote Sensing Datasets

BDD-Net: An End-to-End Multiscale Residual CNN for Earthquake-Induced Building Damage Detection

Deep Bayesian U-Nets for Efficient, Robust and Reliable Post-Disaster Damage Localization

HRTBDA: a network for post-disaster building damage assessment based on remote sensing images

Cross-directional Feature Fusion Network for Building Damage Assessment from Satellite Imagery

AB2CD: AI for Building Climate Damage Classification and Detection

DeepDamageNet: A two-step deep-learning model for multi-disaster building damage segmentation and classification using satellite imagery

MS4D-Net: Multitask-Based Semi-Supervised Semantic Segmentation Framework with Perturbed Dual Mean Teachers for Building Damage Assessment from High-Resolution Remote Sensing Imagery

Multi-step feature fusion for natural disaster damage assessment on satellite images

RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery

BD-SKUNet: Selective-Kernel UNets for Building Damage Assessment in High-Resolution Satellite Images

An efficient change detection method for disaster-affected buildings based on a lightweight residual block in high-resolution remote sensing images

Remote sensing building damage assessment with a multihead neighbourhood attention transformer

Scene-level Buildings Damage Recognition Based on Cross Conv-Transformer

Multi-view deep learning for reliable post-disaster damage classification

Post-flood disaster damaged houses classification based on dual-view image fusion and Concentration-Based Attention Module