Abstract:Using aerial cameras, satellite remote sensing or unmanned aerial vehicles (UAV) equipped with cameras can facilitate search and rescue tasks after disasters. The traditional manual interpretation of huge aerial images is inefficient and could be replaced by machine learning-based methods combined with image processing techniques. Given the development of machine learning, researchers find that convolutional neural networks can effectively extract features from images. Some target detection methods based on deep learning, such as the single-shot multibox detector (SSD) algorithm, can achieve better results than traditional methods. However, the impressive performance of machine learning-based methods results from the numerous labeled samples. Given the complexity of post-disaster scenarios, obtaining many samples in the aftermath of disasters is difficult. To address this issue, a damaged building assessment method using SSD with pretraining and data augmentation is proposed in the current study and highlights the following aspects. (1) Objects can be detected and classified into undamaged buildings, damaged buildings, and ruins. (2) A convolution auto-encoder (CAE) that consists of VGG16 is constructed and trained using unlabeled post-disaster images. As a transfer learning strategy, the weights of the SSD model are initialized using the weights of the CAE counterpart. (3) Data augmentation strategies, such as image mirroring, rotation, Gaussian blur, and Gaussian noise processing, are utilized to augment the training data set. As a case study, aerial images of Hurricane Sandy in 2012 were maximized to validate the proposed method’s effectiveness. Experiments show that the pretraining strategy can improve of 10% in terms of overall accuracy compared with the SSD trained from scratch. These experiments also demonstrate that using data augmentation strategies can improve mAP and mF1 by 72% and 20%, respectively. Finally, the experiment is further verified by another dataset of Hurricane Irma, and it is concluded that the paper method is feasible.

A Class Distance Penalty Deep Learning Method for Post-disaster Building Damage Assessment

Building damage detection from satellite images after natural disasters on extremely imbalanced datasets

Building Damage Detection from Post-Event Aerial Imagery Using Single Shot Multibox Detector

DeepDamageNet: A two-step deep-learning model for multi-disaster building damage segmentation and classification using satellite imagery

Assessment of the Degree of Building Damage Caused by Disaster Using Convolutional Neural Networks in Combination with Ordinal Regression

Deep learning for post‐hurricane aerial damage assessment of buildings

On the Deployment of Post-Disaster Building Damage Assessment Tools Using Satellite Imagery: A Deep Learning Approach.

Semi-supervised learning for improved post-disaster damage assessment from satellite imagery

Technical Solution Discussion for Key Challenges of Operational Convolutional Neural Network-Based Building-Damage Assessment from Satellite Imagery: Perspective from Benchmark xBD Dataset

Methodology for Object-Level Change Detection in Post-Earthquake Building Damage Assessment Based on Remote Sensing Images: OCD-BDA

Identifying Damaged Buildings in Aerial Images Using the Object Detection Method

Rapid Mapping of Volcanic Eruption Building Damage: A Model Based on Prior Knowledge and Few-Shot Fine-Tuning

One-class Damage Detector Using Deeper Fully-Convolutional Data Descriptions for Civil Application

Deep object segmentation and classification networks for building damage detection using the xBD dataset

Automated building damage assessment and large‐scale mapping by integrating satellite imagery, GIS, and deep learning

Knowledge distillation based lightweight building damage assessment using satellite imagery of natural disasters

Interpretability in Convolutional Neural Networks for Building Damage Classification in Satellite Imagery

Deep Bayesian U-Nets for Efficient, Robust and Reliable Post-Disaster Damage Localization

Efficient building damage assessment from post-disaster aerial video using lightweight deep learning models

MS4D-Net: Multitask-Based Semi-Supervised Semantic Segmentation Framework with Perturbed Dual Mean Teachers for Building Damage Assessment from High-Resolution Remote Sensing Imagery

Multi-view deep learning for reliable post-disaster damage classification