Abstract:Presently, the harm to human health created by air pollution has greatly drawn public attention, in particular, vehicle emissions including nitrogen oxides as well as particulate matter. How to predict air quality, e.g., pollutant concentration, efficiently and accurately is a core problem in environmental research. Developing a robust air quality predictive model has become an increasingly important task, holding practical significance in the formulation of effective control policies. Recently, deep learning has progressed significantly in air quality prediction. In this paper, we go one step further and present a neat scheme of masked autoencoders, termed as masked air modeling (MAM), for sequence data self-supervised learning, which addresses the challenges posed by missing data. Specifically, the front end of our pipeline integrates a WRF-CAMx numerical model, which can simulate the process of emission, diffusion, transformation, and removal of pollutants based on atmospheric physics and chemical reactions. Then, the predicted results of WRF-CAMx are concatenated into a time series, and fed into an asymmetric Transformer-based encoder–decoder architecture for pre-training via random masking. Finally, we fine-tune an additional regression network, based on the pre-trained encoder, to predict ozone (O3) concentration. Coupling these two designs enables us to consider the atmospheric physics and chemical reactions of pollutants while inheriting the long-range dependency modeling capabilities of the Transformer. The experimental results indicated that our approach effectively enhances the WRF-CAMx model's predictive capabilities and outperforms pure supervised network solutions. Overall, using advanced self-supervision approaches, our work provides a novel perspective for further improving air quality forecasting, which allows us to increase the smartness and resilience of the air prediction systems. This is due to the fact that accurate prediction of air pollutant concentrations is essential for detecting pollution events and implementing effective response strategies, thereby promoting environmentally sustainable development.

A Deep Autoencoder Model for Pollution Map Recovery with Mobile Sensing Networks

Fine-Grained Air Pollution Inference with Mobile Sensing Systems: A Weather-Related Deep Autoencoder Model

Deep-MAPS: Machine Learning based Mobile Air Pollution Sensing

Generative Model Based Fine-Grained Air Pollution Inference for Mobile Sensing Systems

Large Scale Air Pollution Prediction with Deep Convolutional Networks

A transferred spatio-temporal deep model based on multi-LSTM auto-encoder for air pollution time series missing value imputation

Guiding the Data Learning Process with Physical Model in Air Pollution Inference.

Deep Inferential Spatial-Temporal Network for Forecasting Air Pollution Concentrations

Inferring Fine-Grained Air Pollution Map Via a Spatiotemporal Super-Resolution Scheme

A deep learning and image-based model for air quality estimation

Deep-AIR: A Hybrid CNN-LSTM Framework for Air Quality Modeling in Metropolitan Cities

Improving Air Quality Prediction via Self-Supervision Masked Air Modeling

Forecasting Smog-Related Health Hazard Based on Social Media and Physical Sensor.

Deep-AIR: A Hybrid CNN-LSTM Framework forFine-Grained Air Pollution Forecast

Deep Distributed Fusion Network for Air Quality Prediction

A Hybrid Air Pollution Reconstruction by Adaptive Interpolation Method.

Deep-AIR: A Hybrid CNN-LSTM Framework for Fine-Grained Air Pollution Estimation and Forecast in Metropolitan Cities

Advancing Spatiotemporal Pollutant Dispersion Forecasting with an Integrated Deep Learning Framework for Crucial Information Capture

Longer Time Span Air Pollution Prediction: the Attention and Autoencoder Hybrid Learning Model

Multi-task Deep Neural Network for Air Pollution Prediction and Spatial Effect Analysis

Air Pollution Prediction Based on Discrete Wavelets and Deep Learning