Abstract:With the emergence of Low-Cost Sensor (LCS) devices, measuring real-time data on a large scale has become a feasible alternative approach to more costly devices. Over the years, sensor technologies have evolved which has provided the opportunity to have diversity in LCS selection for the same task. However, this diversity in sensor types adds complexity to appropriate sensor selection for monitoring tasks. In addition, LCS devices are often associated with low confidence in terms of sensing accuracy because of the complexities in sensing principles and the interpretation of monitored data. From the data analytics point of view, data quality is a major concern as low-quality data more often leads to low confidence in the monitoring systems. Therefore, any applications on building monitoring systems using LCS devices need to focus on two main techniques: sensor selection and calibration to improve data quality. In this paper, data-driven techniques were presented for sensor calibration techniques. To validate our methodology and techniques, an air quality monitoring case study from the Bradford district, UK, as part of two European Union (EU) funded projects was used. For this case study, the candidate sensors were selected based on the literature and market availability. The candidate sensors were narrowed down into the selected sensors after analysing their consistency. To address data quality issues, four different calibration methods were compared to derive the best-suited calibration method for the LCS devices in our use case system. In the calibration, meteorological parameters temperature and humidity were used in addition to the observed readings. Moreover, we uniquely considered Absolute Humidity (AH) and Relative Humidity (RH) as part of the calibration process. To validate the result of experimentation, the Coefficient of Determination (R2), Root Mean Square Error (RMSE), and Mean Absolute Error (MAE) were compared for both AH and RH. The experimental results showed that calibration with AH has better performance as compared with RH. The experimental results showed the selection and calibration techniques that can be used in designing similar LCS based monitoring systems.

Quality Control in Weather Monitoring with Dynamic Linear Models

Quality-relevant Modeling and Monitoring of Industrial Cyber-Physical Systems: the Semi-supervised Dynamic Latent Variable Models

The Analysis and Modelling of the Quality of Information Acquired from Weather Station Sensors

An operational framework to automatically evaluate the quality of weather observations from third-party stations

Quality Control Framework of Big Data for Early Warning of Agricultural Meteorological Disasters

Machine Learning Enables Real‐Time Proactive Quality Control: A Proof‐Of‐Concept Study

Process-Quality Monitoring Using Semi-Supervised Probability Latent Variable Regression Models

Supervised Linear Dynamic System Model for Quality Related Fault Detection in Dynamic Processes

Data Quality Control Method of a New Drifting Observation Technology Named Drifting Air-Sea Interface Buoy

Automatic Quality Control of Crowdsourced Rainfall Data with Multiple Noises: A Machine Learning Approach

Research on Data Mining Algorithm of Meteorological Observation Based on Data Quality Control Algorithm

A Visual Voting Framework for Weather Forecast Calibration

Quality control of hourly rain gauge data based on radar and satellite multi-source data

Local Weather Station Design and Development for Cost-Effective Environmental Monitoring and Real-Time Data Sharing

Modeling grain quality characteristics via dynamic models using sensing data

Designing a Framework for Data Quality Validation of Meteorological Data System

Data-Driven Techniques for Low-Cost Sensor Selection and Calibration for the Use Case of Air Quality Monitoring

A Machine Learning Approach for Air-Quality Forecast by Integrating GNSS Radio Occultation Observation and Weather Modeling

STCM: A spatio-temporal calibration model for low-cost air monitoring sensors

Enhancing Extreme Precipitation Forecasts through Machine Learning Quality Control of Precipitable Water Data from Satellite FengYun-2E: A Comparative Study of Minimum Covariance Determinant and Isolation Forest Methods

A Learning Based Approach for Uncertainty Analysis in Numerical Weather Prediction Models