Abstract:The successful development of deep learning and computer vision techniques has recently revolutionized structural health diagnosis (SHD) during life-cycle construction, inspection, maintenance, and disaster prevention for civil infrastructure. Multi-source big data of structural health monitoring (SHM) and inspection are projected into a high-level feature space, and data-driven models are established to map the relationships between inputs and outputs and dig out embedded structural behaviors and implicit physical mechanisms. However, the model performance highly relies on the extensive amount and diversity, intra-class completeness, and inter-class balance of training data, and the generalization ability on scarce data with specific features and particular patterns is challenging under real-world scenarios. To address the above challenges, few-shot learning (FSL) has emerged as a cutting-edge machine learning technique that designs training strategies using only a small amount of annotated data under a limited supervision regime to enhance effectiveness and generalization ability. This article systematically summarizes recent advances in FSL algorithms and the corresponding applications in SHD for civil infrastructure. A unified mathematical framework of FSL is formulated, and an FSL taxonomy is summarized according to intrinsic learning mechanisms and implementation principles, including metric learning-based, optimization-based, transfer learning-based, and generative model-based methods. Various applications of SHD for civil infrastructure under real-world scenarios are reviewed, including remote sensing monitoring, structural damage recognition, post-disaster safety evaluation, and construction risk assessment. Error analyses of approximation, generalization, and optimization errors corresponding to the four paradigms mentioned above are formulated for FSL-based data-driven modeling, which exactly acts as the logical connection with how new thoughts of FSL-based SHD should be designed. Finally, potential prospects of FSL-based SHD are outlined to design weakly supervised FSL considering low-quality data from SHM systems, develop multi-modal FSL for multi-source SHM data, establish cross-task FSL with high commonality and generality for various SHD tasks, and construct lightweight FSL framework with model compression for real-world applications of SHD considering the super-large stream of monitoring data.

Shifting research from defect detection to defect modeling in computer vision-based structural health monitoring

Model-informed Deep Learning Strategy with Vision Measurement for Damage Identification of Truss Structures

A Review of Machine Vision-Based Structural Health Monitoring: Methodologies and Applications

Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends

Deep Learning Architecture for Computer Vision-based Structural Defect Detection

Deep learning-based structural health monitoring

Application of Computer Vision Technology to Structural Health Monitoring of Engineering Structures

A review of the research and application of deep learning-based computer vision in structural damage detection

A Review of Computer Vision-Based Structural Deformation Monitoring in Field Environments

Machine Learning Algorithms in Civil Structural Health Monitoring: A Systematic Review

A review of computer vision–based structural health monitoring at local and global levels

Data-Driven Structural Health Monitoring and Damage Detection through Deep Learning: State-of-the-Art Review

Computer vision and deep learning-based post-earthquake intelligent assessment of engineering structures: Technological status and challenges

Machine learning and structural health monitoring overview with emerging technology and high-dimensional data source highlights

Deep learning-based structural health monitoring through the infusion of optical photos and vibration data

Deep CNN-based visual defect detection: Survey of current literature

Few-shot Learning for Structural Health Diagnosis of Civil Infrastructure

Addressing the Pitfalls of Image-Based Structural Health Monitoring: A Focus on False Positives, False Negatives, and Base Rate Bias

Structural Health Diagnosis under Limited Supervision

Model Uncertainty Quantification for Reliable Deep Vision Structural Health Monitoring

Structural Health Monitoring of RC structures using optic fiber strain measurements: a deep learning approach