Abstract:In climate models, subgrid parameterizations of convection and clouds are one of the main causes of the biases in precipitation and atmospheric circulation simulations. In recent years, due to the rapid development of data science, machine learning (ML) parameterizations for convection and clouds have been demonstrated to have the potential to perform better than conventional parameterizations. Most previous studies were conducted on aqua-planet and idealized models, and the problems of simulation instability and climate drift still exist. Developing an ML parameterization scheme remains a challenging task in realistically configured models. In this paper, a set of residual deep neural networks (ResDNNs) with a strong nonlinear fitting ability is designed to emulate a super-parameterization (SP) with different outputs in a hybrid ML–physical general circulation model (GCM). It can sustain stable simulations for over 10 years under real-world geographical boundary conditions. We explore the relationship between the accuracy and stability by validating multiple deep neural network (DNN) and ResDNN sets in prognostic runs. In addition, there are significant differences in the prognostic results of the stable ResDNN sets. Therefore, trial and error is used to acquire the optimal ResDNN set for both high skill and long-term stability, which we name the neural network (NN) parameterization. In offline validation, the neural network parameterization can emulate the SP in mid- to high-latitude regions with a high accuracy. However, its prediction skill over tropical ocean areas still needs improvement. In the multi-year prognostic test, the hybrid ML–physical GCM simulates the tropical precipitation well over land and significantly improves the frequency of the precipitation extremes, which are vastly underestimated in the Community Atmospheric Model version 5 (CAM5), with a horizontal resolution of 1.9 ∘ × 2.5 ∘ . Furthermore, the hybrid ML–physical GCM simulates the robust signal of the Madden–Julian oscillation with a more reasonable propagation speed than CAM5. However, there are still substantial biases with the hybrid ML–physical GCM in the mean states, including the temperature field in the tropopause and at high latitudes and the precipitation over tropical oceanic regions, which are larger than those in CAM5. This study is a pioneer in achieving multi-year stable climate simulations using a hybrid ML–physical GCM under actual land–ocean boundary conditions that become sustained over 30 times faster than the target SP. It demonstrates the emerging potential of using ML parameterizations in climate simulations.

Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties with Deep Learning Multi-Member and Stochastic Parameterizations

Neural Network Parameterization of Subgrid‐Scale Physics From a Realistic Geography Global Storm‐Resolving Simulation

Stable machine-learning parameterization of subgrid processes for climate modeling at a range of resolutions

Stable Machine-Learning Parameterization of Subgrid Processes with Real Geography and Full-physics Emulation

Using Deep Learning for Convection Parameterization

Stable climate simulations using a realistic general circulation model with neural network parameterizations for atmospheric moist physics and radiation processes

Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations

Use of neural networks for stable, accurate and physically consistent parameterization of subgrid atmospheric processes with good performance at reduced precision

Interpreting and Stabilizing Machine-learning Parametrizations of Convection

Towards Physically Consistent Deep Learning For Climate Model Parameterizations

Stress-testing the coupled behavior of hybrid physics-machine learning climate simulations on an unseen, warmer climate

An Analysis of Deep Learning Parameterizations for Ocean Subgrid Eddy Forcing

Uncertainty Quantification of a Machine Learning Subgrid‐Scale Parameterization for Atmospheric Gravity Waves

Stochastic Parameterization of Moist Physics Using Probabilistic Diffusion Model

Training physics‐based machine‐learning parameterizations with gradient‐free ensemble Kalman methods

Data Imbalance, Uncertainty Quantification, and Generalization via Transfer Learning in Data-driven Parameterizations: Lessons from the Emulation of Gravity Wave Momentum Transport in WACCM

An Ensemble of Neural Networks for Moist Physics Processes, Its Generalizability and Stable Integration

Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model

Latent Diffusion Model for Generating Ensembles of Climate Simulations

Online Learning of Entrainment Closures in a Hybrid Machine Learning Parameterization

Graph Convolutional Neural Networks as Surrogate Models for Climate Simulation