Comparative Study of O3 Forecast Performance Using Multiple Models in Beijing–Tianjin–Hebei and Surrounding Regions

Lili Zhu,Wei Wang,Huihui Zheng,Xiaoyan Wang,Yonghai Huang,Bing Liu

DOI: https://doi.org/10.3390/atmos15030300

IF: 3.11

2024-02-29

Atmosphere

Abstract:In order to systematically understand the operational forecast performance of current numerical, statistical, and ensemble models for O3 in Beijing–Tianjin–Hebei and surrounding regions, a comprehensive evaluation was conducted for the 30 model sets regarding O3 forecasts in June–July 2023. The evaluation parameters for O3 forecasts in the next 1–3 days were found to be more reasonable and practically meaningful than those for longer lead times. When the daily maximum 8 h average concentration of O3 was below 100 μg/m3 or above 200 μg/m3, a significant decrease in the percentage of accurate models was observed. As the number of polluted days in cities increased, the overall percentage of accurate models exhibited a decreasing trend. Statistical models demonstrated better overall performance in terms of metrics such as root mean square error, standard mean bias, and correlation coefficient compared to numerical and ensemble models. Numerical models exhibited significant performance variations, with the best-performing numerical model reaching a level comparable to that of statistical models. This finding suggests that the continuous tuning of operational numerical models has a more pronounced practical effect. Although the best statistical model had higher accuracy than numerical and ensemble models, it showed a significant overestimation when O3 concentrations were low and a significant underestimation when concentrations were high. In particular, the underestimation rate for heavy polluted days was significantly higher than that for numerical and ensemble models. This implies that statistical models may be more prone to missing high-concentration O3 pollution events.

environmental sciences,meteorology & atmospheric sciences

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to systematically evaluate the performance of various numerical, statistical, and ensemble models currently used for ozone (O₃) forecasting in Beijing and surrounding areas (Beijing-Tianjin-Hebei and surrounding regions). Specifically, the study conducts a comprehensive performance assessment of 30 different models during the period from June to July 2023.

#### Main Issues
1. **Model Performance Comparison**: Compare the performance of different types of models (numerical models, statistical models, and ensemble models) at different forecast lead times using various evaluation metrics (such as correlation coefficient, root mean square error, etc.).
2. **Forecast Accuracy Analysis**: Particularly focus on the forecast performance within the next 1 to 3 days and explore the prediction accuracy of these models under different pollution levels (low concentration and high concentration).
3. **Pollution Event Forecasting**: Evaluate the models' ability to forecast pollution events (i.e., situations where the daily maximum 8-hour average concentration exceeds 160 μg/m³).

### Research Findings
- Statistical models perform well on most evaluation metrics (such as root mean square error, standard deviation, etc.), but they significantly overestimate when O₃ concentrations are low and underestimate when concentrations are high.
- The performance of numerical models varies greatly, with the best numerical models reaching levels comparable to statistical models.
- Ensemble models perform well in forecasting pollution events, especially when the number of pollution days is high.
- For forecasts within the next 1 to 3 days, most models can achieve high accuracy, but beyond this range, the accuracy gradually decreases.

Through these findings, the paper aims to provide strong support for environmental management and decision-making in Beijing and surrounding areas.