Abstract:Structural Health Monitoring, Ahead of Print. Despite the significant advancements in computer-vision-based structural damage recognition enhanced by deep learning techniques, challenges persist with training convergence, recognition stability, and model generalization for multi-type damage with small-scale datasets. To address these issues, few-shot learning has emerged as a promising solution to achieve universal damage segmentation using limited annotated images. This study proposes a novel cycle-consistency-constrained few-shot segmentation framework tailored for multi-type structural damage recognition. A cycle-consistency-constrained prototype learning paradigm is constructed to enhance the adequate utilization of limited pixel-level annotations, which is leveraged by establishing a bidirectional mutual supervision mechanism between support and query sets. Subsequently, a non-parametric similarity-guided optimization module is incorporated into the high-level latent feature space of image embedding. This module induces a similarity-driven contrast learning process for each pixel of feature maps and learns universal prototypes that condense the abstract semantic context of foreground (i.e., multi-type damage) and background. Furthermore, a synthetic loss function, which comprises mutually supervised segmentation dice loss, metric loss, and contrastive loss, is designed to ensure the bidirectional pixel-level segmentation accuracy, intra-class compactness, and inter-class separability of learned prototypes for multi-type damage. A multi-type structural damage dataset, encompassing concrete crack, steel fatigue crack, concrete spalling, and steel corrosion, is collected to validate the efficacy, necessity, and generalizability of the proposed method through a series of comparative studies and ablation experiments. The results indicate that segmentation accuracies for multi-type structural damage significantly surpass that of directly training a conventional segmentation model, performing significant improvements in average mean intersection-over-union (mIoU) and mean pixel accuracy (mPA) by 11.5% and 9.1%, respectively. In addition, the adaptability of the proposed method for one-shot learning, using only one annotated image for a completely new damage type, is also corroborated by notable increases of average mIoU and mPA by 8.1% and 7.7%.

Multi-Type Structural Damage Image Segmentation Via Dual-Stage Optimization-Based Few-Shot Learning

Model-informed Deep Learning Strategy with Vision Measurement for Damage Identification of Truss Structures

Cycle-consistency-constrained few-shot learning framework for universal multi-type structural damage segmentation

TASK-SIGNIFICANCE-AWARE META LEARNING FOR FEW-IMAGE-BASED STRUCTURAL DAMAGE RECOGNITION

Task-aware meta-learning paradigm for universal structural damage segmentation using limited images

Attribute-based structural damage identification by few-shot meta learning with inter-class knowledge transfer

Adaptive Cross-Scenario Few-Shot Learning Framework for Structural Damage Detection in Civil Infrastructure

Post‐earthquake Damage Recognition and Condition Assessment of Bridges Using UAV Integrated with Deep Learning Approach

Lightweight semantic segmentation of complex structural damage recognition for actual bridges

Vision-based Multi-Level Synthetical Evaluation of Seismic Damage for RC Structural Components: a Multi-Task Learning Approach

An Attribute-based Few-shot Learning Framework for Structural Damage Classification

Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events

Structural Damage Semantic Segmentation Using Dual-Network Fusion

MS4D-Net: Multitask-Based Semi-Supervised Semantic Segmentation Framework with Perturbed Dual Mean Teachers for Building Damage Assessment from High-Resolution Remote Sensing Imagery

Automatic Pixel‐level Multiple Damage Detection of Concrete Structure Using Fully Convolutional Network

Multi-scale Image-Based Damage Recognition and Assessment for Reinforced Concrete Structures in Post-Earthquake Emergency Response

A hierarchical semantic segmentation framework for computer vision-based bridge damage detection

Structural Health Diagnosis under Limited Supervision

Multidamage Identification in High-Resolution Concrete Bridge Component Imagery Based on Deep Learning

Quantitative Detection of Typical Bridge Surface Damages Based on Global Attention Mechanism and YOLOv7 Network

A few-shot learning method for vibration-based damage detection in civil structures