Abstract:Structural Health Monitoring, Ahead of Print. Data cleaning is necessary to obtain high-quality monitoring data, which consists of two parts: anomaly identification and repair. A high-quality dataset is always used to repair data anomalies in current research, which may be difficult to obtain in practice because of the large number of data anomalies existing in real data. Besides, outliers, baseline shifts, and noise in dataset can lead to wrong missing restoration results. Therefore, the anomaly identification and location are needed to remove outliers, baseline shifts, and noise to regard the repair of these anomalies as missing data restoration. However, the identification of multiple data anomalies is time consuming and challenging. To this end, we propose a Bayesian robust tensor learning model to reconstruct the monitoring data tensor by extracting potential data features of the spatiotemporal tensor. A mixture of Laplace distribution with generalized inverse Gaussian distribution is used to model noise to enhance robustness. The tensor formed from the data containing anomalies can be input directly into the model without the identification and location of the data anomalies in advance. All data anomalies are repaired during the tensor reconstruction process. In addition, outliers, baseline shifts, and noise do not interfere with the missing restoration results owing to the robustness of the model. Furthermore, different cleaning strategies are proposed for dynamic and static response data. The data performance is verified using the real monitoring data of a concrete box girder bridge. The results show that the proposed method exhibits good data-cleaning performance when dealing with data containing a large number of data anomalies. In addition, as the abnormal rate increases, the proposed method still exhibits good data-cleaning performance.

Modelless Data Quality Improvement of Streaming Synchrophasor Measurements by Exploiting the Low-Rank Hankel Structure

Modelless Data Quality Improvement of Streaming Synchrophasor Measurements by Exploiting the Low-Rank Hankel Structure

An Improved Multi-Task Approach for SHM Missing Data Reconstruction Using Attentive Neural Process and Meta-Learning

Low-complexity frame importance modelling and resource allocation scheme for error-resilience H.264 video streaming

Bayesian High-Rank Hankel Matrix Completion for Nonlinear Synchrophasor Data Recovery

Precise Recovery of Corrupted Synchrophasors Based on Autoregressive Bayesian Low-Rank Factorization and Adaptive K-Medoids Clustering

Synchrophasor Missing Data Recovery via Data-Driven Filtering

Hadoop-based Framework for Big Data Analysis of Synchronised Harmonics in Active Distribution Network

Cost-Effective Bad Synchrophasor Data Detection Based on Unsupervised Time Series Data Analytics

Synthesizing Data by Transferring Information in Data‐intensive Regions to Enhance Process Monitoring Performance in Data‐scarce Region

Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors

Mitigating Smart Meter Asynchrony Error Via Multi-Objective Low Rank Matrix Recovery

Hybrid Low-Rank and Sparsity Constraint with Hankel Structure Preservation for Simultaneous Seismic Reconstruction and Denoising

Online Structural Change-Point Detection of High-dimensional Streaming Data via Dynamic Sparse Subspace Learning

Streaming Data Cleaning Based on Speed Change

Tensor-Based Sketching Method for the Low-Rank Approximation of Data Streams

Online Monitoring of Big Data Streams: A Rank-Based Sampling Algorithm by Data Augmentation

Stream Data Cleaning under Speed and Acceleration Constraints

Structural health monitoring data cleaning based on Bayesian robust tensor learning

Enhancing Water Quality Monitoring: an Integrated Machine Learning Framework with Physical Constraints for Imputation and Time Series Downscaling

A Knowledge-Driven Quality-of-Experience Model for Adaptive Streaming Videos