Abstract:Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that allow uncertainty quantification are too expensive for climate models; they are also not robust in the presence of internal climate variability. For example, Markov chain Monte Carlo (MCMC) methods typically require model runs and are sensitive to internal variability noise, rendering them infeasible for climate models. Here we demonstrate an approach to model calibration and uncertainty quantification that requires only model runs and can accommodate internal climate variability. The approach consists of three stages: (a) a calibration stage uses variants of ensemble Kalman inversion to calibrate a model by minimizing mismatches between model and data statistics; (b) an emulation stage emulates the parameter‐to‐data map with Gaussian processes (GP), using the model runs in the calibration stage for training; (c) a sampling stage approximates the Bayesian posterior distributions by sampling the GP emulator with MCMC. We demonstrate the feasibility and computational efficiency of this calibrate‐emulate‐sample (CES) approach in a perfect‐model setting. Using an idealized general circulation model, we estimate parameters in a simple convection scheme from synthetic data generated with the model. The CES approach generates probability distributions of the parameters that are good approximations of the Bayesian posteriors, at a fraction of the computational cost usually required to obtain them. Sampling from this approximate posterior allows the generation of climate predictions with quantified parametric uncertainties. Calibrating climate models with available data and quantifying their uncertainties are essential to make climate predictions accurate and actionable. A primary source of uncertainties in climate models comes from representation of small‐scale processes such as moist convection. Parameters in convection schemes and other parameterizations are usually calibrated by hand, using only a small fraction of data that are available. As a result, the calibration process may miss information about the small‐scale processes in question. This paper presents a proof‐of‐concept, in an idealized setting, of how parameters in climate models can be calibrated using a substantial fraction of the available data, and how uncertainties in the parameters can be quantified. We employ a new algorithm, called calibrate‐emulate‐sample (CES), which makes such calibration and uncertainty quantification feasible for computationally expensive climate models. CES reduces the hundreds of thousands of model runs usually required to quantify uncertainties in computer models to hundreds, thereby achieving about a factor 1,000 speedup. It leads to more robust calibration and uncertainty quantification in the presence of noise arising from chaotic variability of the climate system. We show how uncertainties in climate model parameters can be translated into quantified uncertainties of climate predictions through ensemble integrations. We use time averaged climate statistics to calibrate convective parameters and quantify their uncertainties We demonstrate use of the calibrate‐emulate‐sample algorithm to provide efficient calibration and uncertainty quantification Parametric uncertainty in climate predictions is quantified by sampling from the learnt convective parameter distribution We use time averaged climate statistics to calibrate convective parameters and quantify their uncertainties We demonstrate use of the calibrate‐emulate‐sample algorithm to provide efficient calibration and uncertainty quantification Parametric uncertainty in climate predictions is quantified by sampling from the learnt convective parameter distribution

Quantification and optimization of parameter uncertainty in the grid-point atmospheric model GAMIL2

Investigating the Uncertainty and Transferability of Parameters in Swat Model under Climate Change

Investigating Dynamic Parameter Importance of a High-Complexity Hydrological Model and Implications for Parameterization

An automatic and effective parameter optimization method for model tuning

An Evaluation of the Mellor-Yamada-Janjić Formulation Parameters for the QNSE Scheme in the WRF Model over the Lower Yangtze River Valley

Some Issues in Uncertainty Quantification and Parameter Tuning: a Case Study of Convective Parameterization Scheme in the WRF Regional Climate Model

Quantifying Parametric Uncertainty Effects on Tropical Cloud Fraction in an AGCM

Automatic Tuning of the Community Atmospheric Model (CAM5) by Using Short-Term Hindcasts with an Improved Downhill Simplex Optimization Method

Parameter Optimization For Uncertainty Reduction And Simulation Improvement Of Hydrological Modeling

Uncertainty Quantification and Parameter Tuning in the Cam5 Zhang-Mcfarlane Convection Scheme and Impact of Improved Convection on the Global Circulation and Climate

Evaluation of Grid-Point Atmospheric Model of Iap Lasg Version 2 (Gamil2)

An Effective Parameter Optimization with Radiation Balance Constraint in CAM5 (version 5.3)

Quantification of the Responses of Equatorial Pacific Surface Wind to Uncertain Cloud‐related Parameters in GAMIL2

Estimating Convection Parameters in the GFDL CM2.1 Model Using Ensemble Data Assimilation

Two-moment Bulk Stratiform Cloud Microphysics in the Grid-point Atmospheric Model of IAP LASG （GAMIL）

Climate Impacts of Parameterizing Subgrid Variation and Partitioning of Land Surface Heat Fluxes to the Atmosphere with the NCAR CESM1.2

Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM

Parametric Sensitivity and Uncertainty Quantification in the Version 1 of E3SM Atmosphere Model Based on Short Perturbed Parameter Ensemble Simulations

Quantifying contributions of uncertainties in physical parameterization schemes and model parameters to overall errors in Noah‐MP dynamic vegetation modeling

LB-SCAM: a learning-based method for efficient large-scale sensitivity analysis and tuning of the Single Column Atmosphere Model (SCAM)

An Efficient Approach for Quantifying Parameter Uncertainty in the SST Turbulence Model