Abstract:In the aftermath of a natural hazard, rapid and accurate building damage assessment from remote sensing imagery is crucial for disaster response and rescue operations. Although recent deep learning-based studies have made considerable improvements in assessing building damage, most state-of-the-art works focus on pixel-based, multi-stage approaches, which are more complicated and suffer from partial damage recognition issues at the building-instance level. In the meantime, it is usually time-consuming to acquire sufficient labeled samples for deep learning applications, making a conventional supervised learning pipeline with vast annotation data unsuitable in time-critical disaster cases. In this study, we present an end-to-end building damage assessment framework integrating multitask semantic segmentation with semi-supervised learning to tackle these issues. Specifically, a multitask-based Siamese network followed by object-based post-processing is first constructed to solve the semantic inconsistency problem by refining damage classification results with building extraction results. Moreover, to alleviate labeled data scarcity, a consistency regularization-based semi-supervised semantic segmentation scheme with iteratively perturbed dual mean teachers is specially designed, which can significantly reinforce the network perturbations to improve model performance while maintaining high training efficiency. Furthermore, a confidence weighting strategy is embedded into the semi-supervised pipeline to focus on convincing samples and reduce the influence of noisy pseudo-labels. The comprehensive experiments on three benchmark datasets suggest that the proposed method is competitive and effective in building damage assessment under the circumstance of insufficient labels, which offers a potential artificial intelligence-based solution to respond to the urgent need for timeliness and accuracy in disaster events.

Deep object segmentation and classification networks for building damage detection using the xBD dataset

BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images

Embedded System for Road Damage Detection by Deep Convolutional Neural Network

DeepDamageNet: A two-step deep-learning model for multi-disaster building damage segmentation and classification using satellite imagery

Mbda-net: a building damage assessment model based on a multi-scale fusion network

Post-disaster building damage assessment based on improved U-Net

Building Damage Detection Using U-Net with Attention Mechanism from Pre- and Post-Disaster Remote Sensing Datasets

HRTBDA: a network for post-disaster building damage assessment based on remote sensing images

MS4D-Net: Multitask-Based Semi-Supervised Semantic Segmentation Framework with Perturbed Dual Mean Teachers for Building Damage Assessment from High-Resolution Remote Sensing Imagery

Deep learning‐based multi‐class damage detection for autonomous post‐disaster reconnaissance

AB2CD: AI for Building Climate Damage Classification and Detection

Scene-level Buildings Damage Recognition Based on Cross Conv-Transformer

Identifying Damaged Buildings in Aerial Images Using the Object Detection Method

Transferability of Convolutional Neural Network Models for Identifying Damaged Buildings Due to Earthquake

Superpixel-Based Building Damage Detection from Post-earthquake Very High Resolution Imagery Using Deep Neural Networks

Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events

Technical Solution Discussion for Key Challenges of Operational Convolutional Neural Network-Based Building-Damage Assessment from Satellite Imagery: Perspective from Benchmark xBD Dataset

Post-flood disaster damaged houses classification based on dual-view image fusion and Concentration-Based Attention Module

Building damage detection from satellite images after natural disasters on extremely imbalanced datasets

An efficient change detection method for disaster-affected buildings based on a lightweight residual block in high-resolution remote sensing images

Deep Bayesian U-Nets for Efficient, Robust and Reliable Post-Disaster Damage Localization