Abstract:Abstract. Numerical air quality models (AQMs) have been applied more frequently over the past decade to address diverse scientific and regulatory issues associated with deteriorated air quality in China. Thorough evaluation of a model's ability to replicate monitored conditions (i.e., a model performance evaluation or MPE) helps to illuminate the robustness and reliability of the baseline modeling results and subsequent analyses. However, with numerous input data requirements, diverse model configurations, and the scientific evolution of the models themselves, no two AQM applications are the same and their performance results should be expected to differ. MPE procedures have been developed for Europe and North America, but there is currently no uniform set of MPE procedures and associated benchmarks for China. Here we present an extensive review of model performance for fine particulate matter (PM2.5) AQM applications to China and, from this context, propose a set of statistical benchmarks that can be used to objectively evaluate model performance for PM2.5 AQM applications in China. We compiled MPE results from 307 peer-reviewed articles published between 2006 and 2019, which applied five of the most frequently used AQMs in China. We analyze influences on the range of reported statistics from different model configurations, including modeling regions and seasons, spatial resolution of modeling grids, temporal resolution of the MPE, etc. Analysis using a random forest method shows that the choices of emission inventory, grid resolution, and aerosol- and gas-phase chemistry are the top three factors affecting model performance for PM2.5. We propose benchmarks for six frequently used evaluation metrics for AQM applications in China, including two tiers – “goals” and “criteria” – where goals represent the best model performance that a model is currently expected to achieve and criteria represent the model performance that the majority of studies can meet. Our results formed a benchmark framework for the modeling performance of PM2.5 and its chemical species in China. For instance, in order to meet the goal and criteria, the normalized mean bias (NMB) for total PM2.5 should be within 10 % and 20 %, while the normalized mean error (NME) should be within 35 % and 45 %, respectively. The goal and criteria values of correlation coefficients for evaluating hourly and daily PM2.5 are 0.70 and 0.60, respectively; corresponding values are higher when the index of agreement (IOA) is used (0.80 for goal and 0.70 for criteria). Results from this study will support the ever-growing modeling community in China by providing a more objective assessment and context for how well their results compare with previous studies and to better demonstrate the credibility and robustness of their AQM applications prior to subsequent regulatory assessments.

Supplementary Material to &quot;model Bias in Simulating Major Chemical Components of PM&lt;sub&gt;2.5&lt;/sub&gt; in China&quot;

Model bias in simulating major chemical components of PM<sub>2.5</sub> in China

Model Bias in Simulating Major Chemical Components of PM2.5 in China

Supplementary Material to &quot;impacts of Condensable Particulate Matter on Atmospheric Organic Aerosols and Fine Particulate Matter (pm&lt;sub&gt;2.5&lt;/sub&gt;) in China&quot;

The Simulations of Sulfuric Acid Concentration and New Particle Formation in an Urban Atmosphere in China

Evaluation of CMIP6 model simulations of PM2.5 and its components over China

Aerosol Chemical Component: Simulations with WRF-Chem and Comparison with Observations in Nanjing

Impacts of Condensable Particulate Matter on Atmospheric Organic Aerosols and Fine Particulate Matter (PM2.5) in China

Source Apportionment of PM2.5 Nitrate and Sulfate in China Using a Source-Oriented Chemical Transport Model

Impacts of condensable particulate matter on atmospheric organic aerosols and fine particulate matter (PM 2.5 ) in China

An Amended Chemical Mass Balance Model For Source Apportionment Of Pm2.5 In Typical Chinese Eastern Coastal Cities

Chemical Profiles of Particulate Matter Emitted from Anthropogenic Sources in Selected Regions of China

Recommendations on benchmarks for numerical air quality model applications in China – Part 1: PM<sub>2.5</sub> and chemical species

One-year simulation of ozone and particulate matter in Chinausing WRF/CMAQ modeling system

Global Chemical Composition Of Ambient Fine Particulate Matter For Exposure Assessment

One-year simulation of ozone and particulate matter in China using WRF/CMAQ modeling system

Source Apportionment and Secondary Organic Aerosol Estimation of PM 2.5 in an Urban Atmosphere in China

Insights into the compositional differences of PM1 and PM2.5 from aerosol mass spectrometer measurements in Beijing, China

Source Apportionment of Fine Organic Carbon at an Urban Site of Beijing Using a Chemical Mass Balance Model

Source apportionment of PM2.5 using online and offline measurements of chemical components in Tianjin, China

Source Assessment of Atmospheric Fine Particulate Matter in a Chinese Megacity: Insights from Long-Term, High-Time Resolution Chemical Composition Measurements from Shanghai Flagship Monitoring Supersite

Supplementary Material to &amp;quot;model Bias in Simulating Major Chemical Components of PM&amp;lt;sub&amp;gt;2.5&amp;lt;/sub&amp;gt; in China&amp;quot;

Model bias in simulating major chemical components of PM&lt;sub&gt;2.5&lt;/sub&gt; in China