Abstract:Day by day pollution in cities is increasing due to urbanization. One of the biggest challenges posed by the rapid migration of inhabitants into cities is increased air pollution. Sustainable Development Goal 11 indicates that 99 percent of the world's urban population breathes polluted air. In such a trend of urbanization, predicting the concentrations of pollutants in advance is very important. Predictions of pollutants would help city administrations to take timely measures for ensuring Sustainable Development Goal 11. In data engineering, imputation and the removal of outliers are very important steps prior to forecasting the concentration of air pollutants. For pollution and meteorological data, missing values and outliers are critical problems that need to be addressed. This paper proposes a novel method called multiple iterative imputation using autoencoder-based long short-term memory (MIA-LSTM) which uses iterative imputation using an extra tree regressor as an estimator for the missing values in multivariate data followed by an LSTM autoencoder for the detection and removal of outliers present in the dataset. The preprocessed data were given to a multivariate LSTM for forecasting PM2.5 concentration. This paper also presents the effect of removing outliers and missing values from the dataset as well as the effect of imputing missing values in the process of forecasting the concentrations of air pollutants. The proposed method provides better results for forecasting with a root mean square error (RMSE) value of 9.8883. The obtained results were compared with the traditional gated recurrent unit (GRU), 1D convolutional neural network (CNN), and long short-term memory (LSTM) approaches for a dataset of the Aotizhonhxin area of Beijing in China. Similar results were observed for another two locations in China and one location in India. The results obtained show that imputation and outlier/anomaly removal improve the accuracy of air pollution forecasting.

The impact of data imputation on air quality prediction problem

Comparative Analysis of Machine Learning-Based Imputation Techniques for Air Quality Datasets with High Missing Data Rates

Comparison of Imputation Methods for Missing Values in Air Pollution Data: Case Study on Sydney Air Quality Index

A transferred spatio-temporal deep model based on multi-LSTM auto-encoder for air pollution time series missing value imputation

Data analysis and preprocessing techniques for air quality prediction: a survey

Median-KNN Regressor-SMOTE-Tomek Links for Handling Missing and Imbalanced Data in Air Quality Prediction

Handling missing data in near real-time environmental monitoring: A system and a review of selected methods

An Intelligent Missing Data Imputation Techniques: A Review

Missing Traffic Data: Comparison of Imputation Methods

A Spatiotemporal Prediction Framework for Air Pollution Based on Deep RNN

Selection of statistical technique for imputation of single site-univariate and multisite–multivariate methods for particulate pollutants time series data with long gaps and high missing percentage

Novel MIA-LSTM Deep Learning Hybrid Model with Data Preprocessing for Forecasting of PM2.5

Evaluation of data imputation approaches for multi-stream building systems data1

Managing Large Dataset Gaps in Urban Air Quality Prediction: DCU-Insight-AQ at MediaEval 2022

Recover Missing Sensor Data with Iterative Imputing Network

An Experimental Survey of Missing Data Imputation Algorithms

Comparison of Missing Data Imputation Methods in Time Series Forecasting

Missing Data Imputation for Transportation Research: an Overview

A Benchmark for Data Imputation Methods

Multiview data fusion technique for missing value imputation in multisensory air pollution dataset

Temporal-Spatial Aggregated Urban Air Quality Inference With Heterogeneous Big Data