Abstract:Clean air in cities improves our health and overall quality of life and helps fight climate change and preserve our environment. High-resolution measures of pollutants' concentrations can support the identification of urban areas with poor air quality and raise citizens' awareness while encouraging more sustainable behaviors. Recent advances in Internet of Things (IoT) technology have led to extensive use of low-cost air quality sensors for hyper-local air quality monitoring. As a result, public administrations and citizens increasingly rely on information obtained from sensors to make decisions in their daily lives and mitigate pollution effects. Unfortunately, in most sensing applications, sensors are known to be error-prone. Thanks to Artificial Intelligence (AI) technologies, it is possible to devise computationally efficient methods that can automatically pinpoint anomalies in those data streams in real time. In order to enhance the reliability of air quality sensing applications, we believe that it is highly important to set up a data-cleaning process. In this work, we propose AIrSense, a novel AI-based framework for obtaining reliable pollutant concentrations from raw data collected by a network of low-cost sensors. It enacts an anomaly detection and repairing procedure on raw measurements before applying the calibration model, which converts raw measurements to concentration measurements of gasses. There are very few studies of anomaly detection in raw air quality sensor data (millivolts). Our approach is the first that proposes to detect and repair anomalies in raw data before they are calibrated by considering the temporal sequence of the measurements and the correlations between different sensor features. If at least some previous measurements are available and not anomalous, it trains a model and uses the prediction to repair the observations; otherwise, it exploits the previous observation. Firstly, a majority voting system based on three different algorithms detects anomalies in raw data. Then, anomalies are repaired to avoid missing values in the measurement time series. In the end, the calibration model provides the pollutant concentrations. Experiments conducted on a real dataset of 12,000 observations produced by 12 low-cost sensors demonstrated the importance of the data-cleaning process in improving calibration algorithms' performances.

Data Cleaning Based on Multi-sensor Spatiotemporal Correlation

Space-Time Correlation Based Fault Correction of Wireless Sensor Networks

An Energy-Efficient Data Collection Scheme for Wireless Sensor Networks

A Weighted Moving Average-based Approach for Cleaning Sensor Data

Distributed Spatial Correlation-Based Clustering for Approximate Data Collection in Wsns

Model-driven data cleaning for signal processing system in sensor networks

Using Temporal Correlation and Time Series to Detect Missing Activity-Driven Sensor Events.

STCM: A spatio-temporal calibration model for low-cost air monitoring sensors

Safety Monitoring of Power Industrial Control Terminals Based on Data Cleaning

Structural health monitoring data cleaning based on Bayesian robust tensor learning

Detecting Abnormal Events on Binary Sensors in Smart Home Environments

Detection Of Water-Quality Contamination Events Based On Multi-Sensor Fusion Using An Extented Dempster-Shafer Method

Contamination Event Detection Method Based On The Longest Common Subsequence Analysis Using Multiple Water Quality Parameters

Contamination Event Detection Method Using Multi-Stations Temporal-Spatial Information Based on Bayesian Network in Water Distribution Systems

Time Series Data Cleaning under Expressive Constraints on Both Rows and Columns

Cleaning of Abnormal Wind Speed Power Data Based on Quartile RANSAC Regression

Multiscale water quality contamination events detection based on sensitive time scales reconstruction

RelSen: An Optimization-based Framework for Simultaneously Sensor Reliability Monitoring and Data Cleaning

A Common-Factor Approach for Multivariate Data Cleaning with an Application to Mars Phoenix Mission Data

Anomaly Detection and Repairing for Improving Air Quality Monitoring

Task-oriented analysis and visualization of correlation patterns in multi-sensor time series