Abstract:The widespread application of sophisticated structural health monitoring systems in civil infrastructures produces a large volume of data. As a result, the analysis and mining of structural health monitoring data have become hot research topics in the field of civil engineering. However, the harsh environment of civil structures causes the data measured by structural health monitoring systems to be contaminated by multiple anomalies, which seriously affect the data analysis results. This is one of the main barriers to automatic real-time warning, because it is difficult to distinguish the anomalies caused by structural damage from those related to incorrect data. Existing methods for data cleansing mainly focus on noise filtering, whereas the detection of incorrect data requires expertise and is very time-consuming. Inspired by the real-world manual inspection process, this article proposes a computer vision and deep learning–based data anomaly detection method. In particular, the framework of the proposed method includes two steps: data conversion by data visualization, and the construction and training of deep neural networks for anomaly classification. This process imitates human biological vision and logical thinking. In the data visualization step, the time series signals are transformed into image vectors that are plotted piecewise in grayscale images. In the second step, a training dataset consisting of randomly selected and manually labeled image vectors is input into a deep neural network or a cluster of deep neural networks, which are trained via techniques termed stacked autoencoders and greedy layer-wise training. The trained deep neural networks can be used to detect potential anomalies in large amounts of unchecked structural health monitoring data. To illustrate the training procedure and validate the performance of the proposed method, acceleration data from the structural health monitoring system of a real long-span bridge in China are employed. The results show that the multi-pattern anomalies of the data can be automatically detected with high accuracy.

Signal Generation for Bolt Loosening Detection with Unbalanced Datasets Based on the CBAM-VAE

Vibration Signal Generation Using Conditional Variational Autoencoder for Class Imbalance Problem

A machine learning-based data augmentation strategy for structural damage classification in civil infrastructure system

Unsupervised Machine Anomaly Detection Using Autoencoder and Temporal Convolutional Network.

A novel imbalance fault diagnosis method based on data augmentation and hybrid deep learning models

Autonomous bolt loosening detection using deep learning

A method for automated bolt-loosening monitoring and assessment using impedance technique and deep learning

Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment

Addressing data scarcity using audio signal augmentation and deep learning for bolt looseness prediction

Loosening Identification of Multi-Bolt Connections Based on Wavelet Transform and ResNet-50 Convolutional Neural Network

Data-Augmentation Based CBAM-ResNet-GCN Method for Unbalance Fault Diagnosis of Rotating Machinery

Signal Anomaly Detection of Bridge SHM System Based on Two-Stage Deep Convolutional Neural Networks

A Novel Cross-Domain Data Augmentation and Bearing Fault Diagnosis Method Based on an Enhanced Generative Model

Bolt Loosening Status Classification via WaveEnergy Dissipation Measurements withTemperature-Compensated Deep Learning byPiezoelectric Active Sensing

Bolt-Loosening Detection Using 1D and 2D Input Data Based on Two-Stream Convolutional Neural Networks

Fault Diagnosis Method for Imbalanced Data Based on Multi-Signal Fusion and Improved Deep Convolution Generative Adversarial Network

Data Anomaly Detection for Structural Health Monitoring Based on a Convolutional Neural Network

An efficient robotic-assisted bolt-ball joint looseness monitoring approach using CBAM-enhanced lightweight ResNet

Multi-objective variational autoencoder: an application for smart infrastructure maintenance

Computer vision and deep learning–based data anomaly detection method for structural health monitoring

A New Bolt Defect Identification Method Incorporating Attention Mechanism and Wide Residual Networks