Abstract:Abstract. Numerical air quality models (AQMs) have been applied more frequently over the past decade to address diverse scientific and regulatory issues associated with deteriorated air quality in China. Thorough evaluation of a model's ability to replicate monitored conditions (i.e., a model performance evaluation or MPE) helps to illuminate the robustness and reliability of the baseline modeling results and subsequent analyses. However, with numerous input data requirements, diverse model configurations, and the scientific evolution of the models themselves, no two AQM applications are the same and their performance results should be expected to differ. MPE procedures have been developed for Europe and North America, but there is currently no uniform set of MPE procedures and associated benchmarks for China. Here we present an extensive review of model performance for fine particulate matter (PM2.5) AQM applications to China and, from this context, propose a set of statistical benchmarks that can be used to objectively evaluate model performance for PM2.5 AQM applications in China. We compiled MPE results from 307 peer-reviewed articles published between 2006 and 2019, which applied five of the most frequently used AQMs in China. We analyze influences on the range of reported statistics from different model configurations, including modeling regions and seasons, spatial resolution of modeling grids, temporal resolution of the MPE, etc. Analysis using a random forest method shows that the choices of emission inventory, grid resolution, and aerosol- and gas-phase chemistry are the top three factors affecting model performance for PM2.5. We propose benchmarks for six frequently used evaluation metrics for AQM applications in China, including two tiers – “goals” and “criteria” – where goals represent the best model performance that a model is currently expected to achieve and criteria represent the model performance that the majority of studies can meet. Our results formed a benchmark framework for the modeling performance of PM2.5 and its chemical species in China. For instance, in order to meet the goal and criteria, the normalized mean bias (NMB) for total PM2.5 should be within 10 % and 20 %, while the normalized mean error (NME) should be within 35 % and 45 %, respectively. The goal and criteria values of correlation coefficients for evaluating hourly and daily PM2.5 are 0.70 and 0.60, respectively; corresponding values are higher when the index of agreement (IOA) is used (0.80 for goal and 0.70 for criteria). Results from this study will support the ever-growing modeling community in China by providing a more objective assessment and context for how well their results compare with previous studies and to better demonstrate the credibility and robustness of their AQM applications prior to subsequent regulatory assessments.

Design and Demonstration of a Next-Generation Air Quality Attainment Assessment System for PM 2 . 5 and O 3

Design and Demonstration of a Next-Generation Air Quality Attainment Assessment System for PM2.5 and O3.

Modeling Study on Atmospheric Environmental Capacity of Major Pollutants Constrained by PM_(2.5) Compliance of Chinese Cities

An Assessment of the Potential Health Benefits of Realizing the Goals for PM 10 in the Updated Chinese Ambient Air Quality Standard

Comprehensive Evaluation of Air Pollution Emission Permit Allocation: Effectiveness, Efficiency, and Equity in China's Environmental Management Framework

A case study of development and application of a streamlined control and response modeling system for PM2.5 attainment assessment in China

Drivers of Improved PM2.5 Air Quality in China from 2013 to 2017.

Development of an Integrated Policy Making Tool for Assessing Air Quality and Human Health Benefits of Air Pollution Control

Assessment of Air Quality Benefits from National Air Pollution Control Policies in China. Part II: Evaluation of Air Quality Predictions and Air Quality Benefits Assessment

Data Assimilation of Ambient Concentrations of Multiple Air Pollutants Using an Emission-Concentration Response Modeling Framework

Development and Application of the Scientific Decision Support Platform for Air Pollution Prevention and Control

Assessment of Air Quality Benefits from National Air Pollution Control Policies in China. Part I: Background, Emission Scenarios and Evaluation of Meteorological Predictions

Development and case study of a science-based software platform to support policy making on air quality.

One-year simulation of ozone and particulate matter in Chinausing WRF/CMAQ modeling system

Study on an Air Quality Evaluation Model for Beijing City Under Haze-Fog Pollution Based on New Ambient Air Quality Standards

One-year simulation of ozone and particulate matter in China using WRF/CMAQ modeling system

Feasibility and Difficulties of China's New Air Quality Standard Compliance: PRD Case of PM2.5 and Ozone from 2010 to 2025

Recommendations on benchmarks for numerical air quality model applications in China – Part 1: PM<sub>2.5</sub> and chemical species

Multiconstituent Data Assimilation with WRF‐Chem/DART: Potential for Adjusting Anthropogenic Emissions and Improving Air Quality Forecasts over Eastern China

An integrated air quality modeling system coupling regional-urban and street models in Beijing

Evaluation of a New Real-Time Source Apportionment System of PM2.5 and Its Implication on Rapid Aging of Vehicle Exhaust