Abstract:Structural Health Monitoring, Ahead of Print. Monitoring bridges through vibration responses of drive-by vehicles enables efficient and low-cost bridge maintenance by allowing each vehicle to inspect multiple bridges and eliminating the needs for installing and maintaining sensors on every bridge. However, many existing drive-by monitoring approaches are based on supervised learning models that require massive labeled data from every bridge. It is expensive and time-consuming, if not impossible, to obtain these labeled data. Furthermore, directly applying a supervised learning model trained on one bridge to new bridges would result in low accuracy due to the shift between different bridges' data distributions. Moreover, when we have multiple tasks (e.g., damage detection, localization, and quantification), the distribution shifts become more challenging than having only one task because different tasks have distinct distribution shifts and varying task difficulties. To this end, we introduce HierMUD, the first Hierarchical Multi-task Unsupervised Domain adaptation framework that transfers the damage diagnosis model learned from one bridge to a new bridge without requiring any labels from the new bridge. Specifically, our framework learns a hierarchical neural network model in an adversarial way to extract features that are informative to multiple tasks and invariant across multiple bridges. To match distributions over multiple tasks, we design a new loss function based on a newly derived generalization risk bound to adaptively assign higher weights to tasks with more shifted distributions. To learn multiple tasks with varying task difficulties, we split them into easy-to-learn and hard-to-learn tasks based on their distributions. Then, we formulate a feature hierarchy to utilize more learning resources to improve the hard-to-learn tasks' performance. We evaluate our framework with experimental data from 2 bridges and 3 vehicles. We achieve up to 2X better performance than baseline methods, including average accuracy of 95% for damage detection, 93% for localization, and 0.38 lbs mean absolute error for quantification.

Effective multilayer hybrid classification approach for automatic bridge health assessment on large-scale uncertain data

Deep Learning‐based Automatic Classification of Three‐level Surface Information in Bridge Inspection

An End-to-End Framework With Multisource Monitoring Data for Bridge Health Anomaly Identification

Multi-label Concrete Bridge Damage Classification Using Graph Convolution

Hierarchical Multilabel Ship Classification in Remote Sensing Images Using Label Relation Graphs

Semi-Supervised Multiresolution Classification Using Adaptive Graph Filtering with Application to Indirect Bridge Structural Health Monitoring

Structural Health Monitoring Data Reconstruction of a Concrete Cable-Stayed Bridge Based on Wavelet Multi-Resolution Analysis and Support Vector Machine

Faulty data detection and classification for bridge structural health monitoring via statistical and deep‐learning approach

Transfer learning-based data anomaly detection for structural health monitoring

Automated bridge component recognition from point clouds using deep learning

HierMUD: Hierarchical multi-task unsupervised domain adaptation between bridges for drive-by damage diagnosis

Application of C-LSTM Networks to Automatic Labeling of Vehicle Dynamic Response Data for Bridges

Optimal tuning of three deep learning methods with signal processing and anomaly detection for multi-class damage detection of a large-scale bridge

Multilevel Structural Components Detection and Segmentation toward Computer Vision-Based Bridge Inspection

Progressive Classifier Mechanism for Bridge Expansion Joint Health Status Monitoring System Based on Acoustic Sensors

Classification and regression-based convolutional neural network and long short-term memory configuration for bridge damage identification using long-term monitoring vibration data

Hybrid Elman Neural Network and an Invasive Weed Optimization Method for Bridge Defect Recognition

Multiclass anomaly detection in imbalanced structural health monitoring data using convolutional neural network

Automated semantic segmentation of bridge point cloud based on local descriptor and machine learning

Data mining algorithms for bridge health monitoring: Kohonen clustering and LSTM prediction approaches

Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images