Abstract:Presently, the harm to human health created by air pollution has greatly drawn public attention, in particular, vehicle emissions including nitrogen oxides as well as particulate matter. How to predict air quality, e.g., pollutant concentration, efficiently and accurately is a core problem in environmental research. Developing a robust air quality predictive model has become an increasingly important task, holding practical significance in the formulation of effective control policies. Recently, deep learning has progressed significantly in air quality prediction. In this paper, we go one step further and present a neat scheme of masked autoencoders, termed as masked air modeling (MAM), for sequence data self-supervised learning, which addresses the challenges posed by missing data. Specifically, the front end of our pipeline integrates a WRF-CAMx numerical model, which can simulate the process of emission, diffusion, transformation, and removal of pollutants based on atmospheric physics and chemical reactions. Then, the predicted results of WRF-CAMx are concatenated into a time series, and fed into an asymmetric Transformer-based encoder–decoder architecture for pre-training via random masking. Finally, we fine-tune an additional regression network, based on the pre-trained encoder, to predict ozone (O3) concentration. Coupling these two designs enables us to consider the atmospheric physics and chemical reactions of pollutants while inheriting the long-range dependency modeling capabilities of the Transformer. The experimental results indicated that our approach effectively enhances the WRF-CAMx model's predictive capabilities and outperforms pure supervised network solutions. Overall, using advanced self-supervision approaches, our work provides a novel perspective for further improving air quality forecasting, which allows us to increase the smartness and resilience of the air prediction systems. This is due to the fact that accurate prediction of air pollutant concentrations is essential for detecting pollution events and implementing effective response strategies, thereby promoting environmentally sustainable development.

Meta-Learning-Based Spatial-Temporal Adaption for Coldstart Air Pollution Prediction

Machine learning-assisted mapping of city-scale air temperature: Using sparse meteorological data for urban climate modeling and adaptation

Air Quality Prediction Model Based on Spatiotemporal Data Analysis and Metalearning

Learning Adaptive Probabilistic Models for Uncertainty-Aware Air Pollution Prediction

Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction

Hyperparameter-Optimization-Inspired Long Short-Term Memory Network for Air Quality Grade Prediction.

Forecasting Smog-Related Health Hazard Based on Social Media and Physical Sensor.

Forecasting urban air pollution using multi-site spatiotemporal data fusion method (Geo-BiLSTMA)

Air Quality Prediction at New Stations Using Spatially Transferred Bi-Directional Long Short-Term Memory Network.

A Model-driven and Data-driven Fusion Framework for Accurate Air Quality Prediction

A Deep Multitask Learning Approach for Air Quality Prediction

Deep Inferential Spatial-Temporal Network for Forecasting Air Pollution Concentrations

A deep spatio-temporal learning network for continuous citywide air quality forecast based on dense monitoring data

Design a regional and multistep air quality forecast model based on deep learning and domain knowledge

Guiding the Data Learning Process with Physical Model in Air Pollution Inference.

Deep Random Subspace Learning: A Spatial-Temporal Modeling Approach for Air Quality Prediction

A Variational Bayesian Approach for Fast Adaptive Air Pollution Prediction

Two-stage deep learning hybrid framework based on multi-factor multi-scale and intelligent optimization for air pollutant prediction and early warning

Improving Air Quality Prediction via Self-Supervision Masked Air Modeling

Air pollutant prediction model based on transfer learning two-stage attention mechanism

Region Profile Enhanced Urban Spatio-Temporal Prediction Via Adaptive Meta-Learning