Monitoring Data Quality Control for a Water Distribution System Using Data Self-Recognition

LIU Shuming,WU Yipeng,CHE Han
DOI: https://doi.org/10.16511/j.cnki.qhdxxb.2017.26.054
2017-01-01
Abstract:Humans cannot process the vast amounts of monitoring data produced every minute, so data faults may not been seen and the data can become unreliable. Systems are needed to recognize abnormalities and invalid data. This paper describes a data self-recognition approach based on independent monitoring sites. 56 months of monitoring data was collected from one water distribution network in Beijing. The data was cut into different time-slice series for an autoregressive moving average model (ARMA). This provided a prediction confidence interval to identify the outliers in the test data series. The results gave good outlier identification with data feedback correction. Thus, the system provides data quality control with self-recognition that easily and efficiently deals with invalid data.
What problem does this paper attempt to address?