Abstract:Unmanned aerial systems (UASs) are increasingly playing a crucial role in earthquake emergency response and disaster assessment due to their ease of operation, mobility, and low cost. However, post-earthquake scenes are complex, with many forms of damaged buildings. UAS imagery has a high spatial resolution, but the resolution is inconsistent between different flight missions. These factors make it challenging for existing methods to accurately identify individual damaged buildings in UAS images from different scenes, resulting in coarse segmentation masks that are insufficient for practical application needs. To address these issues, this paper proposed DB-Transfiner, a building damage instance segmentation method for post-earthquake UAS imagery based on the Mask Transfiner network. This method primarily employed deformable convolution in the backbone network to enhance adaptability to collapsed buildings of arbitrary shapes. Additionally, it used an enhanced bidirectional feature pyramid network (BiFPN) to integrate multi-scale features, improving the representation of targets of various sizes. Furthermore, a lightweight Transformer encoder has been used to process edge pixels, enhancing the efficiency of global feature extraction and the refinement of target edges. We conducted experiments on post-disaster UAS images collected from the 2022 Luding earthquake with a surface wave magnitude (Ms) of 6.8 in the Sichuan Province of China. The results demonstrated that the average precisions (AP) of DB-Transfiner, APbox and APseg, are 56.42% and 54.85%, respectively, outperforming all other comparative methods. Our model improved the original model by 5.00% and 4.07% in APbox and APseg, respectively. Importantly, the APseg of our model was significantly higher than the state-of-the-art instance segmentation model Mask R-CNN, with an increase of 9.07%. In addition, we conducted applicability testing, and the model achieved an average correctness rate of 84.28% for identifying images from different scenes of the same earthquake. We also applied the model to the Yangbi earthquake scene and found that the model maintained good performance, demonstrating a certain level of generalization capability. This method has high accuracy in identifying and assessing damaged buildings after earthquakes and can provide critical data support for disaster loss assessment.

Geometric consistency enhanced deep convolutional encoder-decoder for urban seismic damage assessment by UAV images

Building Information Extraction and Earthquake Damage Prediction in an Old Urban Area Based on UAV Oblique Photogrammetry

Geometry-informed deep learning-based structural component segmentation of post-earthquake buildings

Geometry‐guided semantic segmentation for post‐earthquake buildings using optical remote sensing images

Automated regional seismic damage assessment of buildings using an unmanned aerial vehicle and a convolutional neural network

An Improved Instance Segmentation Method for Fast Assessment of Damaged Buildings Based on Post-Earthquake UAV Images

Post‐earthquake Damage Recognition and Condition Assessment of Bridges Using UAV Integrated with Deep Learning Approach

A Two-Stage Seismic Damage Assessment Method for Small, Dense, and Imbalanced Buildings in Remote Sensing Images

Efficient building damage assessment from post-disaster aerial video using lightweight deep learning models

Scene-level Buildings Damage Recognition Based on Cross Conv-Transformer

Rapid seismic-damage assessment method for buildings on a regional scale based on spectrum-compatible data augmentation and deep learning

Identification of Building Damage from UAV-Based Photogrammetric Point Clouds Using Supervoxel Segmentation and Latent Dirichlet Allocation Model

Rapid Mapping of Volcanic Eruption Building Damage: A Model Based on Prior Knowledge and Few-Shot Fine-Tuning

Earthquake-Damaged Buildings Detection in Very High-Resolution Remote Sensing Images Based on Object Context and Boundary Enhanced Loss

High-Quality Damaged Building Instance Segmentation Based on Improved Mask Transfiner Using Post-Earthquake UAS Imagery: A Case Study of the Luding Ms 6.8 Earthquake in China

DeepDamageNet: A two-step deep-learning model for multi-disaster building damage segmentation and classification using satellite imagery

Deep object segmentation and classification networks for building damage detection using the xBD dataset

Superpixel-Based Building Damage Detection from Post-earthquake Very High Resolution Imagery Using Deep Neural Networks

Earthquake Crack Detection From Aerial Images Using a Deformable Convolutional Neural Network

Transferability of Convolutional Neural Network Models for Identifying Damaged Buildings Due to Earthquake

Deep learning‐based multi‐class damage detection for autonomous post‐disaster reconnaissance