Selecting CMIP6 GCMs for CORDEX dynamical downscaling: model performance, independence, and climate change signals

Giovanni Di Virgilio,Fei Ji,Eugene Tam,Nidhi Nishant,Jason P. Evans,Chris Thomas,Matthew L. Riley,Kathleen Beyer,Michael R. Grose,Sugata Narsey,Francois Delage,Matthew Riley,Michael Grose

DOI: https://doi.org/10.1029/2021EF002625

2022-03-23

Abstract:Earth's Future, Accepted Article.

What problem does this paper attempt to address?

Evaluation of CMIP6 models toward dynamical downscaling over 14 CORDEX domains

DOI: https://doi.org/10.1007/s00382-022-06355-5

IF: 4.901

2022-06-11

Climate Dynamics

Abstract:Both reliability and independence of global climate model (GCM) simulation are essential for model selection to generate a reasonable uncertainty range of dynamical downscaling simulations. In this study, we evaluate the performance and interdependency of 37 GCMs from the Coupled Model Intercomparison Project Phase 6 (CMIP6) in terms of seven key large-scale driving fields over 14 CORDEX domains. A multivariable integrated evaluation method is used to evaluate and rank the models' ability to simulate multiple variables in terms of their climatological mean and interannual variability. The results suggest that the model performance varies considerably with seasons, domains, and variables evaluated, and no model outperforms in all aspects. However, the multi-model ensemble mean performs much better than almost all models. Among 37 CMIP6 models, the MPI-ESM1-2-HR and FIO-ESM-2-0 rank top two due to their overall good performance across all domains. To measure the model interdependency in terms of multiple fields, we define the similarity of multivariate error fields between pairwise models. Our results indicate that the dependence exists between most of the CMIP6 models, and the models sharing the same idea or/and concept generally show less independence. Furthermore, we hierarchically cluster the top 15 models with good performance based on the similarity of multivariate error fields to identify relatively independent models. Our evaluation can provide useful guidance on the selection of CMIP6 models based on their performance and relative independence, which helps to generate a more reliable ensemble of dynamical downscaling simulations with reasonable inter-model spread.

meteorology & atmospheric sciences
Selecting CMIP6 GCMs for CORDEX Dynamical Downscaling over Southeast Asia Using a Standardised Benchmarking Framework

DOI: https://doi.org/10.5194/gmd-2024-84

IF: 5.1

2024-05-15

Geoscientific Model Development

Abstract:Downscaling global climate models (GCMs) provides crucial, high-resolution data needed for informed decision-making at regional scales. However, there is no uniform approach to select the most suitable GCMs. Over Southeast Asia (SEA), observations are sparse and have large uncertainties, complicating GCM selection especially for rainfall. To guide this selection, we apply a standardised benchmarking framework to select CMIP6 GCMs for dynamical downscaling over SEA, addressing current observational limitations. This framework identifies fit-for-purpose models through a two-step process: (a) selecting models that meet minimum performance requirements in simulating the fundamental characteristics of rainfall (e.g., bias, spatial pattern, annual cycle, and trend) and (b) selecting models from (a) to further assess whether key precipitation drivers (monsoon) and teleconnections from modes of variability are captured [El Niño-Southern-Oscillation (ENSO) and Indian Ocean Dipole (IOD)]. GCMs generally exhibit wet biases, particularly over the complex terrain of the Maritime Continent. Evaluations from the first step identify 19 out of 32 GCMs that meet our minimum performance expectations in simulating rainfall. These models also consistently capture atmospheric circulations and teleconnections with modes of variability over the region but overestimate their strength. Ultimately, we identify eight GCMs meeting our performance expectations. There are obvious, high-performing GCMs from allied modelling groups, highlighting the dependency of the subset of models identified from the framework. Therefore, further tests on model independence, data availability, and future climate change spread are conducted, resulting in a final sub-set of two independent models that align with our a priori expectations for downscaling over CORDEX-SEA.

geosciences, multidisciplinary
Selecting CMIP6 global climate models (GCMs) for Coordinated Regional Climate Downscaling Experiment (CORDEX) dynamical downscaling over Southeast Asia using a standardised benchmarking framework

Phuong Loan Nguyen,Lisa V. Alexander,Marcus J. Thatcher,Son C. H. Truong,Rachael N. Isphording,John L. McGregor

DOI: https://doi.org/10.5194/gmd-17-7285-2024

IF: 5.1

2024-10-15

Geoscientific Model Development

Abstract:Downscaling global climate models (GCMs) provides crucial high-resolution data needed for informed decision-making at regional scales. However, there is no uniform approach to select the most suitable GCMs. Over Southeast Asia (SEA), observations are sparse and have large uncertainties, complicating GCM selection especially for rainfall. To guide this selection, we apply a standardised benchmarking framework to select CMIP6 GCMs for dynamical downscaling over SEA, addressing current observational limitations. This framework identifies fit-for-purpose models through a two-step process: (a) selecting models that meet minimum performance requirements in simulating the fundamental characteristics of rainfall (e.g. bias, spatial pattern, annual cycle and trend) and (b) selecting models from (a) to further assess whether key precipitation drivers (monsoon) and teleconnections from modes of variability are captured, i.e. the El Niño–Southern Oscillation (ENSO) and Indian Ocean Dipole (IOD). GCMs generally exhibit wet biases, particularly over the complex terrain of the Maritime Continent. Evaluations from the first step identify 19 out of 32 GCMs that meet our minimum performance expectations in simulating rainfall. These models also consistently capture atmospheric circulations and teleconnections with modes of variability over the region but overestimate their strength. Ultimately, we identify eight GCMs meeting our performance expectations. There are obvious, high-performing GCMs from allied modelling groups, highlighting the dependency of the subset of models identified from the framework. Therefore, further tests of model independence, data availability and future climate change spread are conducted, resulting in a final subset of two independent models that align with our a priori expectations for downscaling over the Coordinated Regional Climate Downscaling Experiment –Southeast Asia (CORDEX-SEA).

geosciences, multidisciplinary
Evaluation of CMIP6 GCMs over the CONUS for downscaling studies

Moetasim Ashfaq,Deeksha Rastogi,Joy Kitson,Muhammad Adnan Abid,Shih‐Chieh Kao

DOI: https://doi.org/10.1029/2022JD036659

2022-10-10

Abstract:Despite the necessity of Global Climate Models (GCMs) sub‐selection in downscaling studies, an objective approach for their selection is currently lacking. Building on the previously established concepts in GCMs evaluation frameworks, we develop a weighted averaging technique to remove the redundancy in the evaluation criteria and rank 37 GCMs from the 6th phase of the Coupled Models Intercomparison Project (CMIP6) over the contiguous United States (CONUS). GCMs are rated based on their average performance across 66 evaluation measures in the historical period (1981–2014) after each metric is weighted between zero and one, depending on its uniqueness. The robustness of the outcome is tested by repeating the process with the empirical orthogonal function analysis in which each GCM is ranked based on its sum of distances from the reference in the principal component space. The two methodologies work in contrasting ways to remove the metrics redundancy but eventually develop similar GCMs rankings. A disparity in GCMs' behavior related to their sensitivity to the size of the evaluation suite is observed, highlighting the need for comprehensive multi‐variable GCMs evaluation at varying timescales for determining their skillfulness over a region. The sub‐selection goal is to use a representative set of skillful models over the region of interest without substantial overlap in their future climate responses and modeling errors in representing historical climate. Additional analyses of GCMs' independence and spread in their future projections provide the necessary information to objectively select GCMs while keeping all aspects of necessity in view.

meteorology & atmospheric sciences
Assessing mean climate change signals in the global CORDEX-CORE ensemble

Claas Teichmann,Daniela Jacob,Armelle Reca Remedio,Thomas Remke,Lars Buntemeyer,Peter Hoffmann,Arne Kriegsmann,Ludwig Lierhammer,Katharina Bülow,Torsten Weber,Kevin Sieck,Diana Rechid,Gaby S. Langendijk,Erika Coppola,Filippo Giorgi,James M. Ciarlo`,Francesca Raffaele,Graziano Giuliani,Gao Xuejie,Taleena Rae Sines,Jose Abraham Torres-Alavez,Sushant Das,Fabio Di Sante,Emanuela Pichelli,Russel Glazer,Moetasim Ashfaq,Melissa Bukovsky,Eun-Soon Im

DOI: https://doi.org/10.1007/s00382-020-05494-x

IF: 4.901

2020-11-09

Climate Dynamics

Abstract:Abstract The new Coordinated Output for Regional Evaluations (CORDEX-CORE) ensemble provides high-resolution, consistent regional climate change projections for the major inhabited areas of the world. It serves as a solid scientific basis for further research related to vulnerability, impact, adaptation and climate services in addition to existing CORDEX simulations. The aim of this study is to investigate and document the climate change information provided by the CORDEX-CORE simulation ensemble, as a part of the World Climate Research Programme (WCRP) CORDEX community. An overview of the annual and monthly mean climate change information in selected regions in different CORDEX domains is presented for temperature and precipitation, providing the foundation for detailed follow-up studies and applications. Initially, two regional climate models (RCMs), REMO and RegCM were used to downscale global climate model output. The driving simulations by AR5 global climate models (AR5-GCMs) were selected to cover the spread of high, medium, and low equilibrium climate sensitivity at a global scale. The CORDEX-CORE ensemble has doubled the spatial resolution compared to the previously existing CORDEX simulations in most of the regions (25 $$\,\mathrm {km}$$ km (0.22 $$^{\circ }$$ ∘ ) versus 50 $$\,\mathrm {km}$$ km (0.44 $$^{\circ }$$ ∘ )) leading to a potentially improved representation of, e.g., physical processes in the RCMs. The analysis focuses on changes in the IPCC physical climate reference regions. The results show a general reasonable representation of the spread of the temperature and precipitation climate change signals of the AR5-GCMs by the CORDEX-CORE simulations in the investigated regions in all CORDEX domains by mostly covering the AR5 interquartile range of climate change signals. The simulated CORDEX-CORE monthly climate change signals mostly follow the AR5-GCMs, although for specific regions they show a different change in the course of the year compared to the AR5-GCMs, especially for RCP8.5, which needs to be investigated further in region specific process studies.

meteorology & atmospheric sciences
Delivering an improved framework for the new generation of CMIP6-driven EURO-CORDEX regional climate simulations

E. Katragkou,S. P. Sobolowski,C. Teichmann,F. Solmon,V. Pavlidis,D. Rechid,P. Hoffmann,J. Fernandez,G. Nikulin,D. Jacob

DOI: https://doi.org/10.1175/bams-d-23-0131.1

IF: 9.116

2024-03-06

Bulletin of the American Meteorological Society

Abstract:CORDEX (Coordinated Regional Downscaling EXperiment) is a coordinated international activity that has produced ensembles of regional climate simulations with domains that cover all land areas of the world. These ensembles are used by a wide range of practitioners that include the scientific community, policy makers, stakeholders from the public and private sector. They also provide the scientific basis for the Intergovernmental Panel on Climate Change-Assessment Reports. As its next phase now launches, the CMIP6-CORDEX datasets are expected to populate community repositories over the next couple of years, with updated state-of-the-art regional climate data that will further support national and regional communities and inform their climate adaptation and mitigation strategies. The protocol presented here focuses on the European domain (EURO-CORDEX). It takes the international CORDEX protocol covering all fourteen global domains as its template. However, it expands on the international protocol in specific areas; Incorporates historical and projected aerosol trends into the regional models in a consistent way with CMIP6-Global Climate Models, to allow for a better comparison of global vs. regional trends; Produces more climate variables to better support sectorial climate impact assessments; Takes into account the recent scientific developments addressed in the CORDEX Flagship Pilot Studies, enabling a better assessment of processes and phenomena relevant to regional climate (e.g. land use change, aerosol, convection, urban environment). Here, we summarize the scientific analysis which led to the new simulation protocol and highlight the improvements we expect in the new generation regional climate ensemble.

meteorology & atmospheric sciences
Climate change projections for CORDEX-Africa with COSMO-CLM regional climate model and differences with the driving global climate models

Alessandro Dosio,Hans-Jürgen Panitz

DOI: https://doi.org/10.1007/s00382-015-2664-4

IF: 4.901

2015-06-04

Climate Dynamics

Abstract:AbstractIn the framework of the coordinated regional climate downscaling experiment (CORDEX), an ensemble of climate change projections for Africa has been created by downscaling the simulations of four global climate models (GCMs) by means of the consortium for small-scale modeling (COSMO) regional climate model (RCM) (COSMO-CLM, hereafter, CCLM). Differences between the projected temperature and precipitation simulated by CCLM and the driving GCMs are analyzed and discussed. The projected increase of seasonal temperature is found to be relatively similar between GCMs and RCM, although large differences (more than 1 °C) exist locally. Differences are also found for extreme-event related quantities, such as the spread of the upper end of the maximum temperature probability distribution function and, in turn, the duration of heat waves. Larger uncertainties are found in the future precipitation changes; this is partly a consequence of the inter-model (GCMs) variability over some areas (e.g. Sahel). However, over other regions (e.g. Central Africa) the rainfall trends simulated by CCLM and the GCMs show opposite signs, with CCLM showing a significant reduction in precipitation at the end of the century. This uncertain and sometimes contrasting behaviour is further investigated by analyzing the different models’ response to the land–atmosphere interaction and feedback. Given the large uncertainty associated with inter-model variability across GCMs and the reduced spread in the results when a single RCM is used for downscaling, we strongly emphasize the importance of exploiting fully the CORDEX-Africa multi-GCM/multi-RCM ensemble in order to assess the robustness of the climate change signal and, possibly, to identify and quantify the many sources of uncertainty that still remain.

meteorology & atmospheric sciences
Quantification of The Performance of CMIP6 Models for Dynamic Downscaling in The North Pacific and Northwest Pacific Oceans

Seok-Geun Oh,Bong-Gwan Kim,Yang-Ki Cho,Seok-Woo Son

DOI: https://doi.org/10.1007/s13143-023-00320-w

IF: 6.6235

2023-03-31

Asia-Pacific Journal of Atmospheric Sciences

Abstract:Selecting a reliable global climate model as the driving forcing in simulations with dynamic downscaling is critical for obtaining a reliable regional ocean climate. With respect to their accuracy in providing physical quantities and long-term trends, we quantify the performances of 17 models from the Coupled Model Inter-comparison Project Phase 6 (CMIP6) over the North Pacific (NP) and Northwest Pacific (NWP) oceans for 1979–2014. Based on normalized evaluation measures, each model's performance for a physical quantity is mainly quantified by the performance score (PS), which ranges from 0 to 100. Overall, the CMIP6 models reasonably reproduce the physical quantities of the driving variables and the warming ocean heat content and temperature trends. However, their performances significantly depend on the variables and region analyzed. The EC-Earth-Veg and CNRM-CM6-1 models show the best performances for the NP and NWP oceans, respectively, with the highest PS values of 85.89 and 76.97, respectively. The EC-Earth3 model series are less sensitive to the driving variables in the NP ocean, as reflected in their PS. The model performance is significantly dependent on the driving variables in the NWP ocean. Nevertheless, providing a better physical quantity does not correlate with a better performance for trend. However, MRI-ESM2-0 model shows a high performance for the physical quantity in the NWP ocean with warming trends similar to references, and it could thus be used as an appropriate driving forcing in dynamic downscaling of this ocean. This study provides objective information for studies involving dynamic downscaling of the NP and NWP oceans.

meteorology & atmospheric sciences
Evaluation of the Performance of CMIP6 Model Simulations for the Asian-Pacific Region: Perspectives from Multiple Dimensions

Shuaifeng Song,Xuezhen Zhang,Xiaodong Yan

DOI: https://doi.org/10.21203/rs.3.rs-1271963/v1

2022-01-27

Abstract:Abstract A comprehensive climate model assessment from multiple dimensions is critical for model selection to reduce uncertainties. Here, we evaluated the performance of seven models involved in the Coupled Model Intercomparison Project-6 (CMIP6) by comparing the simulated meteorological variables at the near-surface (sea ice cover and sea surface temperature) and pressure levels (air temperature, specific humidity, zonal wind, meridional wind, and geopotential height at 850 hPa, 500 hPa, and 200 hPa) to those using ERA5 reanalysis data for the 1995-2014 period from the perspectives of climatological and interannual variability. Then, a comprehensive rating index approach was applied to rank the models. The results show that the CMIP6 models could mostly reproduce the spatial variability of the climatology. However, there were also systematic biases. The sea ice cover and sea surface temperature exhibited noticeable biases of approximately -13.2% and 0.6 °C, respectively. Additionally, all models underestimated air temperature and geopotential height, while overestimating specific humidity in the middle troposphere and zonal and meridional wind speeds in the upper troposphere. Regarding interannual variability, the CMIP6 models performed well for the variables at a pressure level of 850 hPa and with sea ice cover. Taken together, all variables showed that NorESM2-MM exhibited good performance in terms of climatology, while MPI-ESM1-2-LR exhibited good interannual variability. Overall, in regard to the comprehensive rate index, MPI-ESM1-2-LR performed the best among the seven models. This study provides valuable scientific references for selecting the available CMIP6 models as lateral boundary conditions towards dynamical downscaling over Asian-Pacific area.
Uncertainty-informed selection of CMIP6 Earth system model subsets for use in multisectoral and impact models

Snyder, Abigail

DOI: https://doi.org/10.5194/esd-15-1301-2024

IF: 5.4583

2024-10-16

Earth System Dynamics

Abstract:Earth system models (ESMs) and general circulation models (GCMs) are heavily used to provide inputs to sectoral impact and multisector dynamic models, which include representations of energy, water, land, economics, and their interactions. Therefore, representing the full range of model uncertainty, scenario uncertainty, and interannual variability that ensembles of these models capture is critical to the exploration of the future co-evolution of the integrated human–Earth system. The pre-eminent source of these ensembles has been the Coupled Model Intercomparison Project (CMIP). With more modeling centers participating in each new CMIP phase, the size of the model archive is rapidly increasing, which can be intractable for impact modelers to effectively utilize due to computational constraints and the challenges of analyzing large datasets. In this work, we present a method to select a subset of the latest phase, CMIP6, featuring models for use as inputs to a sectoral impact or multisector dynamics models, while prioritizing preservation of the range of model uncertainty, scenario uncertainty, and interannual variability in the full CMIP6 ensemble results. This method is intended to help impact modelers select climate information from the CMIP archive efficiently for use in downstream models that require global coverage of climate information. This is particularly critical for large-ensemble experiments of multisector dynamic models that may be varying additional features beyond climate inputs in a factorial design, thus putting constraints on the number of climate simulations that can be used. We focus on temperature and precipitation outputs of CMIP6 models, as these are two of the most used variables among impact models, and many other key input variables for impacts are at least correlated with one or both of temperature and precipitation (e.g., relative humidity). Besides preserving the multi-model ensemble variance characteristics, we prioritize selecting CMIP6 models in the subset that preserve the very likely distribution of equilibrium climate sensitivity values as assessed by the latest Intergovernmental Panel on Climate Change (IPCC) report. This approach could be applied to other output variables of climate models and, possibly when combined with emulators, offers a flexible framework for designing more efficient experiments on human-relevant climate impacts. It can also provide greater insight into the properties of existing CMIP6 models.

geosciences, multidisciplinary
Performance evaluation of CMIP6 models for application to hydrological modelling studies – A case study of Australia

Riwaz Kumar Adhikari,Abdullah Gokhan Yilmaz,Bandita Mainali,Phil Dyson

DOI: https://doi.org/10.1016/j.scitotenv.2024.174015

IF: 9.8

2024-06-23

The Science of The Total Environment

Abstract:Accurate estimation of climate change impacts on catchment hydrology is essential for effective future water management. The efficacy of such estimations is dependent on proper climate model selection. In this study, an attempt was made to formulate a methodology for climate model selection, evaluating eight climate models from the sixth phase of the Coupled Model Intercomparison Project (CMIP6). The models were assessed for their ability to simulate variables used in hydrological studies and large-scale atmospheric circulation influencing rainfall in Australia. Five statistical indicators Root Mean Square Error (RMSE), Spatial Correlation (SC), Percentage Bias (Pbias), Normalized Root Mean Square Error (NRMSE), and Nash-Sutcliffe Efficiency (NSE) were used to evaluate the performance, and the models were ranked through Compromise Programming (CP), a multiple criteria decision making technique. Results show that HadGEM3-GC31-LL performed well in most of the categories considered and was top top-ranked model overall followed by GFDL-ESM4, CESM2-CAM6-RT, and CanESM5 for Australia. Conversely, MIROC6 consistently ranked lower in most of the categories. In the context of simulating hydrological variables, CESM2-CAM6-RT, HadGEM3-GC31-LL, and GFDL-ESM4 emerged as the top three models. The robustness of the proposed methodology suggests its applicability for model selection, making it a replicable approach for climate change impact assessment studies in diverse regions.

environmental sciences
Performance evaluation of CORDEX-Africa regional climate models in simulating climate variables over Ethiopian main rift valley: Evidence from Gidabo river basin for impact modeling studies

Rediet Girma,Christine Fürst,Awdenegest Moges

DOI: https://doi.org/10.1016/j.dynatmoce.2022.101317

IF: 2.049

2022-09-01

Dynamics of Atmospheres and Oceans

Abstract:Measuring the simulation skill of regional climate models (RCMs) is vital in selecting the best performing model that can be used for climate change studies. To that end, the performance of eleven Coordinated Regional Climate Downscaling Experiment (CORDEX) Africa RCMs were evaluated against observed datasets from 1991 to 2005 over Gidabo river basin (GRB), main Ethiopian rift valley. RCMs’ outputs were evaluated using coefficient of variation (CV), percent of bias (PBIAS), Root Means Square Error (RMSE), Pearson's correlation coefficient (r), revised R-squared (RR2), Taylor Skill Score (TSS), Mann-Kendall (MK) trend test and Sen’s slope estimator. The results confirm the difference of RCMs in capturing the annual and seasonal climate variables. In relation to the spatial pattern of the rainfall, RACMO22T (EC-EARTH) strongly reproduced the mean annual rainfall. CCLM4–8 (MPI) and mean ensemble reproduced the annual patterns of the observed rainfall despite the fact with varying rainfall amounts reproduced. The seasonal rainfall pattern was satisfactorily captured by RACMO22T (EC-EARTH), CCLM4–8 (MPI) and REMO2009 (MPI). The agreement between the observed and modeled rainfall is superior in CCLM4–8 (MPI) and RACMO22T (EC-EARTH) at station level. CRCM5 (MPI) satisfactory replicated the patterns of both minimum and maximum temperature. RACMO22T (EC-EARTH) showed best performance in simulating annual and seasonal rainfall trends in GRB. In overall, models that performs better in replicating the observed climatology include RACMO22T (EC-EARTH), CCLM4–8 (MPI), CRCM5 (MPI), CCLM4–8 (CNRM), and REMO2009 (EC-EARTH). The study underscored the use of the mean ensemble of model simulation did not always guarantee better agreement with observation than individual models. Therefore prior to climate impact study, it is advisable to correct the systematic bias and employ the multi-model ensemble of best performing models for climate change impact and adaptation studies in the GRB.

meteorology & atmospheric sciences,geochemistry & geophysics,oceanography
Ranking of CMIP 6 climate models in simulating precipitation over India

Degavath Vinod,V. Agilan

DOI: https://doi.org/10.1007/s11600-024-01313-7

IF: 2.293

2024-03-10

Acta Geophysica

Abstract:Understanding how precipitation fluctuates geographically and temporally over a specific place due to climate change is critical. Generally, simulations of general circulation models (GCM) under different scenarios are downscaled to the local scale to study the impact of climate change on precipitation. However, selecting suitable GCMs for the given study area is one of the most hectic tasks, as the performance of GCMs may vary with respect to space and timescale. Therefore, the current study ranks twenty-seven CMIP 6 (Coupled Modelled Intercomparison Project Phase 6) GCMs in simulating precipitation over India for nine times series, including daily, monthly, yearly, and six extreme series extracted with annual maximum and peak over threshold methods. The gridded daily rainfall data provided by the India Meteorological Department (IMD) are used as the observed data. The GCMs' outputs are corrected for the systematic bias using the linear scaling method. The performance of a GCM is assessed with three statistical performance metrics, namely NSE, RMSE, and R 2 . The GCMs' ranks are determined using a multi-criterion decision-making technique named the modified technique of order preference by similarity to an ideal solution (mTOPSIS) for every grid point and nine timescales (i.e., daily, monthly, yearly, and six extreme series). From the results, for the entire India, the top ten recommended CMIP 6 GCMs are FGOALS-g3, HadGEM3-GC31-MM, EC-Earth3, BCC-CSM2-MR, CNRM-CM6-1-HR, CanESM5, AWI-ESM-1-1-LR, MPI-ESM-1-2-HR, IITM-ESM, and INM-CM5-0. The identified best-performing models provide insightful information for better regional climate projections and underscore the necessity of considering multiple model outputs for reliable climate change impact assessments and adaptation strategies in the region.

geochemistry & geophysics
Performance evaluation of CMIP6 climate models for selecting a suitable GCM for future precipitation at different places of Tamil Nadu

Hemanandhini S,Vignesh Rajkumar L

DOI: https://doi.org/10.1007/s10661-023-11454-9

2023-07-11

Abstract:Climate change refers to long-term variations in climate parameters. Future climate information can be projected using a GCM (General Circulation Model). Identifying a particular GCM is crucial for climate impact studies. Researchers are perplexed about selecting a suitable GCM for downscaling to predict future climate parameters. Recent updates to CMIP6 global climate models have included shared socioeconomic pathways based on the IPCC (Intergovernmental Panel on Climate Change) Sixth Assessment Report (AR6). The performance of 24 CMIP6 GCMs in precipitation with a multi-model ensemble filter was compared to IMD (India Meteorological Department) 0.25 × 0.25 degrees rainfall data in Tamil Nadu. The performance was evaluated with the help of Compromise Programming (CP), which involves metrics such as R2 (Pearson correlation co-efficient), PBIAS (Percentage Bias), NRMSE (Normalized Root Mean Square Error), and NSE (Nash-Sutcliffe Efficiency). The GCM ranking was performed through Compromise programming by comparing the IMD data and GCM data. The results of the CP analyses of the statistical metrics suggest that the suitable GCMs for the North-East monsoon are CESM2 for Chennai, CAN-ESM5 for Vellore, MIROC6 for Salem, BCC-CSM2-MR for Thiruvannamalai, MPI-ESM-1-2-HAM for Erode, MPI-ESM1-2-LR for Tiruppur, MPI-ESM1-2-LR for Trichy, MPI-ESM1-2-LR for Pondicherry, MPI-ESM1-2-LR for Dindigul, CNRM-CM6-HR for Thanjavur, MPI-ESM1-2-LR for Thirunelveli and UKESM1-0-LL for Thoothukudi. The appropriate suitable GCMs for South-West monsoon as CESM2 is appropriate for Chennai, IPSL-CM6A-LR for Vellore, CESM2-WACCM-FV2 for Salem, CAMS-CSM1-0 for Thiruvannamalai, MPI-ESM-1-2-HR for Erode, MPI-ESM-1-2-HR for Tiruppur, EC- EARTH3 for Trichy, EC- EARTH3 for Pondicherry, MPI-ESM-1-2-HR for Dindigul, CESM2-FV2 for Thanjavur, ACCESS-CM2 for Thirunelveli and ACCESS-CM2 for Thoothukudi respectively. This study emphasizes the importance of selecting an appropriate GCM. Selecting a suitable GCM will be useful in climate change impact studies and there by suggesting necessary adaptation and mitigation strategies.
European daily precipitation according to EURO-CORDEX regional climate models (RCMs) and high-resolution global climate models (GCMs) from the High-Resolution Model Intercomparison Project (HighResMIP)

Marie-Estelle Demory,Ségolène Berthou,Jesús Fernández,Silje L. Sørland,Roman Brogli,Malcolm J. Roberts,Urs Beyerle,Jon Seddon,Rein Haarsma,Christoph Schär,Erasmo Buonomo,Ole B. Christensen,James M. Ciarlo ̀,Rowan Fealy,Grigory Nikulin,Daniele Peano,Dian Putrasahan,Christopher D. Roberts,Retish Senan,Christian Steger,Claas Teichmann,Robert Vautard

DOI: https://doi.org/10.5194/gmd-13-5485-2020

IF: 5.1

2020-11-11

Geoscientific Model Development

Abstract:Abstract. In this study, we evaluate a set of high-resolution (25–50 km horizontal grid spacing) global climate models (GCMs) from the High-Resolution Model Intercomparison Project (HighResMIP), developed as part of the EU-funded PRIMAVERA (Process-based climate simulation: Advances in high resolution modelling and European climate risk assessment) project, and from the EURO-CORDEX (Coordinated Regional Climate Downscaling Experiment) regional climate models (RCMs) (12–50 km horizontal grid spacing) over a European domain. It is the first time that an assessment of regional climate information using ensembles of both GCMs and RCMs at similar horizontal resolutions has been possible. The focus of the evaluation is on the distribution of daily precipitation at a 50 km scale under current climate conditions. Both the GCM and RCM ensembles are evaluated against high-quality gridded observations in terms of spatial resolution and station density. We show that both ensembles outperform GCMs from the 5th Coupled Model Intercomparison Project (CMIP5), which cannot capture the regional-scale precipitation distribution properly because of their coarse resolutions. PRIMAVERA GCMs generally simulate precipitation distributions within the range of EURO-CORDEX RCMs. Both ensembles perform better in summer and autumn in most European regions but tend to overestimate precipitation in winter and spring. PRIMAVERA shows improvements in the latter by reducing moderate-precipitation rate biases over central and western Europe. The spatial distribution of mean precipitation is also improved in PRIMAVERA. Finally, heavy precipitation simulated by PRIMAVERA agrees better with observations in most regions and seasons, while CORDEX overestimates precipitation extremes. However, uncertainty exists in the observations due to a potential undercatch error, especially during heavy-precipitation events. The analyses also confirm previous findings that, although the spatial representation of precipitation is improved, the effect of increasing resolution from 50 to 12 km horizontal grid spacing in EURO-CORDEX daily precipitation distributions is, in comparison, small in most regions and seasons outside mountainous regions and coastal regions. Our results show that both high-resolution GCMs and CORDEX RCMs provide adequate information to end users at a 50 km scale.

geosciences, multidisciplinary
A multi-criteria decision analysis approach for ranking the performance of CMIP6 models in reproducing precipitation patterns over Abaya-Chamo sub-basin, Ethiopia

Desalegn Laelago Ersado,Admasu Gebeyehu Awoke

DOI: https://doi.org/10.1016/j.heliyon.2024.e32442

IF: 3.776

2024-06-08

Heliyon

Abstract:The most suitable multi-model ensemble set of general circulation models is used to reduce the uncertainty associated with GCM selection and improve the accuracy of the model simulations. This study evaluated the performance of 20 global climate models participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6) in reproducing precipitation patterns over the Abaya-Chamo Sub-basin, Ethiopia. For the validation and selection of the models' capabilities, datasets from the Climate Hazards Infrared Precipitation with Stations (CHIRPS) were used after comparing them with ground observational datasets. The objective was to identify the most suitable multi-model ensemble (MME) of a subset of CMIP6 GCMs to capture the rainfall for the 1981-2014 period over the region. Climate Data Operators (CDOs) were used in climate data processing and extraction, and the Mann-Kendall test and Theil-Sen slope estimator methods were utilized to analyze the trends of the CMIP6 simulations. Four statistical metrics (Nash-Sutcliffe coefficient, percent bias, normalized root mean square error, and Kling-Gupta efficiency) were used to further assess the performance of the models. A multi-criteria decision analysis approach, namely, the technique for order preferences by similarity to an ideal solution (TOPSIS) method, was used to obtain the overall ranks of CMIP6 models and to select the best-performing CMIP6 model in the region. The results indicated that CHIRPS and most of the CMIP6 simulations generally reproduced bimodal precipitation patterns over the region. The CESM2-WACCM, NorESM2-MM, NorESM2-LM, and NorESM2-LM models performed better than the other models in reproducing seasonal patterns for the winter, spring, summer, and autumn seasons, respectively. On the other hand, FGOALS-f3-L revealed the trends of the reference datasets for all seasons. In terms of the NSE, PB, NRMSE, and KGE metrics, EC-Earth3-C, EC-Earth3, EC-Earth3-C, and EC-Earth-C, respectively, were considered good at representing the observed features of precipitation over the region. EC-Earth3-C,EC-Earth3, EC-Earth3-Veg-LR, ACCESS-CM2, MPI-ESM1-2-HR, and CNRM-CM6-1-HR exhibited the best performances in the Abaya-Chamo Sub-basin.
Climate model Selection by Independence, Performance, and Spread (ClimSIPS v1.0.1) for regional applications

Anna L. Merrifield,Lukas Brunner,Ruth Lorenz,Vincent Humphrey,Reto Knutti

DOI: https://doi.org/10.5194/gmd-16-4715-2023

IF: 5.1

2023-08-24

Geoscientific Model Development

Abstract:As the number of models in Coupled Model Intercomparison Project (CMIP) archives increase from generation to generation, there is a pressing need for guidance on how to interpret and best use the abundance of newly available climate information. Users of the latest CMIP6 seeking to draw conclusions about model agreement must contend with an "ensemble of opportunity" containing similar models that appear under different names. Those who used the previous CMIP5 as a basis for downstream applications must filter through hundreds of new CMIP6 simulations to find several best suited to their region, season, and climate horizon of interest. Here we present methods to address both issues, model dependence and model subselection, to help users previously anchored in CMIP5 to navigate CMIP6 and multi-model ensembles in general. In Part I, we refine a definition of model dependence based on climate output, initially employed in Climate model Weighting by Independence and Performance (ClimWIP), to designate discrete model families within CMIP5 and CMIP6. We show that the increased presence of model families in CMIP6 bolsters the upper mode of the ensemble's bimodal effective equilibrium climate sensitivity (ECS) distribution. Accounting for the mismatch in representation between model families and individual model runs shifts the CMIP6 ECS median and 75th percentile down by 0.43 ∘ C, achieving better alignment with CMIP5's ECS distribution. In Part II, we present a new approach to model subselection based on cost function minimization, Climate model Selection by Independence, Performance, and Spread (ClimSIPS). ClimSIPS selects sets of CMIP models based on the relative importance a user ascribes to model independence (as defined in Part I), model performance, and ensemble spread in projected climate outcome. We demonstrate ClimSIPS by selecting sets of three to five models from CMIP6 for European applications, evaluating the performance from the agreement with the observed mean climate and the spread in outcome from the projected mid-century change in surface air temperature and precipitation. To accommodate different use cases, we explore two ways to represent models with multiple members in ClimSIPS, first, by ensemble mean and, second, by an individual ensemble member that maximizes mid-century change diversity within the CMIP overall. Because different combinations of models are selected by the cost function for different balances of independence, performance, and spread priority, we present all selected subsets in ternary contour "subselection triangles" and guide users with recommendations based on further qualitative selection standards. ClimSIPS represents a novel framework to select models in an informed, efficient, and transparent manner and addresses the growing need for guidance and simple tools, so those seeking climate services can navigate the increasingly complex CMIP landscape.

geosciences, multidisciplinary
Evaluation of CMIP6 model performances in simulating fire weather spatiotemporal variability on global and regional scales

Carolina Gallo,Jonathan M. Eden,Bastien Dieppois,Igor Drobyshev,Peter Z. Fulé,Jesús San-Miguel-Ayanz,Matthew Blackett

DOI: https://doi.org/10.5194/gmd-16-3103-2023

IF: 5.1

2023-06-01

Geoscientific Model Development

Abstract:Abstract. Weather and climate play an important role in shaping global wildfire regimes and geographical distributions of burnable area. As projected by the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC-AR6), in the near future, fire danger is likely to increase in many regions due to warmer temperatures and drier conditions. General circulation models (GCMs) are an important resource in understanding how fire danger will evolve in a changing climate, but, to date, the development of fire risk scenarios has not fully accounted for systematic GCM errors and biases. This study presents a comprehensive global evaluation of the spatiotemporal representation of fire weather indicators from the Canadian Forest Fire Weather Index System simulated by 16 GCMs from the sixth Coupled Model Intercomparison Project (CMIP6). While at the global scale, the ensemble mean is able to represent variability, magnitude and spatial extent of different fire weather indicators reasonably well when compared to the latest global fire reanalysis, there is considerable regional and seasonal dependence in the performance of each GCM. To support the GCM selection and application for impact studies, the evaluation results are combined to generate global and regional rankings of individual GCM performance. The findings highlight the value of GCM evaluation and selection in developing more reliable projections of future climate-driven fire danger, thereby enabling decision makers and forest managers to take targeted action and respond to future fire events.

geosciences, multidisciplinary
Improving Earth System Model Selection Methodologies for Projecting Hydroclimatic Change: Case Study in the Pacific Northwest

Nicholas D. Lybarger,Abigail Smith,Andrew J. Newman,Ethan D. Gutmann,Andrew W. Wood,Christopher D. Frans,Michael D. Warner,Jeffrey R. Arnold

DOI: https://doi.org/10.1029/2023jd039774

2024-04-06

Journal of Geophysical Research Atmospheres

Abstract:Abstract The rapid expansion of Earth system model (ESM) data available from the Coupled Model Intercomparison Project Phase 6 (CMIP6) necessitates new methods to evaluate the performance and suitability of ESMs used for hydroclimate applications as these extremely large data volumes complicate stakeholder efforts to use new ESM outputs in updated climate vulnerability and impact assessments. We develop an analysis framework to inform ESM sub‐selection based on process‐oriented considerations and demonstrate its performance for a regional application in the US Pacific Northwest. First, a suite of global and regional metrics is calculated, using multiple historical observation datasets to assess ESM performance. These metrics are then used to rank CMIP6 models, and a culled ensemble of models is selected using a trend‐related diagnostics approach. This culling strategy does not dramatically change climate scenario trend projections in this region, despite retaining only 20% of the CMIP6 ESMs in the final model ensemble. The reliability of the culled trend projection envelope and model response similarity is also assessed using a perfect model framework. The absolute difference in temperature trend projections is reduced relative to the full ensemble compared to the model for each SSP scenario, while precipitation trend errors are largely unaffected. In addition, we find that the spread of the culled ensemble temperature and precipitation trends includes the trend of the “truth” model ∼83%‐92% of the time. This analysis demonstrates a reliable method to reduce ESM ensemble size that can ease use of ESMs for creating and understanding climate vulnerability and impact assessments.

meteorology & atmospheric sciences
Assessing the separate contribution of the domain, RCM and GCM to the uncertainty in CORDEX simulations over the overlapped regions that include Jordan

Hebah Alkhasoneh,Clinton Rowe

DOI: https://doi.org/10.1002/joc.8620

2024-09-12

International Journal of Climatology

Abstract:The findings of this research show that the impact of the selection of the CORDEX domain in the overlapped regions is minimal. This supports the reliability of building a super‐ensemble by using all available simulations from all CORDEX domains, which could help enhance the reliability of climate change projections and thus improve the development of adaptation plans. On the other hand, the effect of either GCM or RCM on the total variance is significant. Figure shows the spatial average distribution of the variance decomposition of the climatology of temperature and precipitation for both the choice of domain/GCM analysis (a) and the choice of RCM/GCM analysis (b). Colours indicate the spatially averaged contributions for domain (red), GCM (blue), RCM (orange) and the combined domain/GCM or the combined RCM/GCM contribution (grey). The Coordinated Regional Downscaling Experiment (CORDEX) offers a framework for regional climate downscaling experiments over continental‐based domains that overlap; this allows for conducting multimodel analysis. However, a question is raised about the uncertainty due to domain selection. This study aims to evaluate the sensitivity of CORDEX simulations to the choices of domain, downscaling regional climate model (RCM) and driving global model (GCM) over a Middle East study region, including Jordan. Understanding these sensitivities helps assess simulation uncertainties and enhance regional climate change projections. Taylor diagrams and variance decomposition analyses were used to analyse seasonal temperature and precipitation climatologies. The results indicate that the domain contribution to variance is negligible, whereas the choice of GCM and RCM strongly influences simulations. Variance in temperature is significantly impacted by the driving model (GCM), whereas RCM has a higher influence on precipitation, which reflects their large‐scale versus local nature. The results of this study support the development of multidomain ensembles since projections produced by the same GCM–RCM model combination are consistent across different overlapping domains. On the other hand, this approach facilitates the consideration as well as a comprehensive quantification of the uncertainties arising from the utilization of multiple GCMs and RCMs within such an ensemble. This improves the reliability of regional climate information, thus facilitating the development of effective adaptation strategies and mitigation plans.

meteorology & atmospheric sciences

Selecting CMIP6 GCMs for CORDEX dynamical downscaling: model performance, independence, and climate change signals

Evaluation of CMIP6 models toward dynamical downscaling over 14 CORDEX domains

Selecting CMIP6 GCMs for CORDEX Dynamical Downscaling over Southeast Asia Using a Standardised Benchmarking Framework

Selecting CMIP6 global climate models (GCMs) for Coordinated Regional Climate Downscaling Experiment (CORDEX) dynamical downscaling over Southeast Asia using a standardised benchmarking framework

Evaluation of CMIP6 GCMs over the CONUS for downscaling studies

Assessing mean climate change signals in the global CORDEX-CORE ensemble

Delivering an improved framework for the new generation of CMIP6-driven EURO-CORDEX regional climate simulations

Climate change projections for CORDEX-Africa with COSMO-CLM regional climate model and differences with the driving global climate models

Quantification of The Performance of CMIP6 Models for Dynamic Downscaling in The North Pacific and Northwest Pacific Oceans

Evaluation of the Performance of CMIP6 Model Simulations for the Asian-Pacific Region: Perspectives from Multiple Dimensions

Uncertainty-informed selection of CMIP6 Earth system model subsets for use in multisectoral and impact models

Performance evaluation of CMIP6 models for application to hydrological modelling studies – A case study of Australia

Performance evaluation of CORDEX-Africa regional climate models in simulating climate variables over Ethiopian main rift valley: Evidence from Gidabo river basin for impact modeling studies

Ranking of CMIP 6 climate models in simulating precipitation over India

Performance evaluation of CMIP6 climate models for selecting a suitable GCM for future precipitation at different places of Tamil Nadu

European daily precipitation according to EURO-CORDEX regional climate models (RCMs) and high-resolution global climate models (GCMs) from the High-Resolution Model Intercomparison Project (HighResMIP)

A multi-criteria decision analysis approach for ranking the performance of CMIP6 models in reproducing precipitation patterns over Abaya-Chamo sub-basin, Ethiopia

Climate model Selection by Independence, Performance, and Spread (ClimSIPS v1.0.1) for regional applications

Evaluation of CMIP6 model performances in simulating fire weather spatiotemporal variability on global and regional scales

Improving Earth System Model Selection Methodologies for Projecting Hydroclimatic Change: Case Study in the Pacific Northwest

Assessing the separate contribution of the domain, RCM and GCM to the uncertainty in CORDEX simulations over the overlapped regions that include Jordan