Dynamical Tests of a Deep-Learning Weather Prediction Model

Gregory J. Hakim,Sanjit Masanam

2023-09-20

Abstract:Global deep-learning weather prediction models have recently been shown to produce forecasts that rival those from physics-based models run at operational centers. It is unclear whether these models have encoded atmospheric dynamics, or simply pattern matching that produces the smallest forecast error. Answering this question is crucial to establishing the utility of these models as tools for basic science. Here we subject one such model, Pangu-weather, to a set of four classical dynamical experiments that do not resemble the model training data. Localized perturbations to the model output and the initial conditions are added to steady time-averaged conditions, to assess the propagation speed and structural evolution of signals away from the local source. Perturbing the model physics by adding a steady tropical heat source results in a classical Matsuno--Gill response near the heating, and planetary waves that radiate into the extratropics. A localized disturbance on the winter-averaged North Pacific jet stream produces realistic extratropical cyclones and fronts, including the spontaneous emergence of polar lows. Perturbing the 500hPa height field alone yields adjustment from a state of rest to one of wind--pressure balance over ~6 hours. Localized subtropical low pressure systems produce Atlantic hurricanes, provided the initial amplitude exceeds about 5 hPa, and setting the initial humidity to zero eliminates hurricane development. We conclude that the model encodes realistic physics in all experiments, and suggest it can be used as a tool for rapidly testing ideas before using expensive physics-based models.

Atmospheric and Oceanic Physics,Machine Learning

What problem does this paper attempt to address?

The paper aims to explore whether deep learning weather forecasting models can encode atmospheric dynamics principles, rather than merely performing pattern matching to minimize prediction errors. The research team tested the Pangu-weather deep learning weather forecasting model through four classic dynamical experiments that are dissimilar to the model's training data. Specifically, the paper focuses on the following aspects:

1. **Steady Tropical Heating**: By introducing a continuous heat source in the tropical region, the study observes whether the model can produce the classic Matsuno–Gill response and the radiation of planetary waves to mid-latitudes.
2. **Extratropical Cyclone Development**: By perturbing a local area in the winter-mean North Pacific jet stream, the study evaluates whether the model can generate realistic extratropical cyclones and fronts, including spontaneously formed polar low-pressure systems.
3. **Geostrophic Adjustment**: By perturbing only the 500hPa height field, the study tests the model's process of adjusting from a stationary state to a wind-pressure balance state.
4. **Hurricane Development**: By perturbing the initial conditions, the study assesses whether a subtropical low-pressure system can generate an Atlantic hurricane and examines the changes in hurricane development when the initial humidity is zero.

Through these experiments, the researchers verified that the Pangu-weather model can produce physically consistent results in all experiments, indicating that the model encodes real atmospheric physical constraints. This finding suggests that the Pangu-weather model can be used as a tool for rapid hypothesis testing, providing preliminary screening before using expensive traditional physical models.