Long-Term Prediction Accuracy Improvement of Data-Driven Medium-Range Global Weather Forecast

Yifan Hu,Fukang Yin,Weimin Zhang,Kaijun Ren,Junqiang Song,Kefeng Deng,Di Zhang

2024-06-26

Abstract:Long-term stability stands as a crucial requirement in data-driven medium-range global weather forecasting. Spectral bias is recognized as the primary contributor to instabilities, as data-driven methods difficult to learn small-scale dynamics. In this paper, we reveal that the universal mechanism for these instabilities is not only related to spectral bias but also to distortions brought by processing spherical data using conventional convolution. These distortions lead to a rapid amplification of errors over successive long-term iterations, resulting in a significant decline in forecast accuracy. To address this issue, a universal neural operator called the Spherical Harmonic Neural Operator (SHNO) is introduced to improve long-term iterative forecasts. SHNO uses the spherical harmonic basis to mitigate distortions for spherical data and uses gated residual spectral attention (GRSA) to correct spectral bias caused by spurious correlations across different scales. The effectiveness and merit of the proposed method have been validated through its application for spherical Shallow Water Equations (SWEs) and medium-range global weather forecasting. Our findings highlight the benefits and potential of SHNO to improve the accuracy of long-term prediction.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper primarily addresses the issue of long-term prediction accuracy in data-driven mid-range global weather forecasting. Specifically, the paper focuses on the following two core problems: 1. **Spectral Bias**: - Data-driven methods struggle to capture small-scale dynamical features, leading to instability in long-term iterative forecasts. 2. **Distortions in Processing Spherical Data**: - Using traditional convolutions to process spherical data introduces distortions, which can cause errors to rapidly amplify during long-term iterations, significantly reducing forecast accuracy. To address these issues, the paper proposes a general neural operator—the Spherical Harmonic Neural Operator (SHNO). This operator mitigates distortions in spherical data processing through the spherical harmonic basis and uses a Gated Residual Spectral Attention mechanism (GRSA) to correct spectral bias caused by spurious cross-scale correlations. Experiments validate the effectiveness and advantages of the proposed method.

Long-Term Prediction Accuracy Improvement of Data-Driven Medium-Range Global Weather Forecast

Spherical Neural Operator Network for Global Weather Prediction

Wind Speed Multi-Step Forecasting Using High-Resolution and Multi-Objective Ensemble Model with Error Correction

Accurate medium-range global weather forecasting with 3D neural networks

A Deep-learning Real-time Bias Correction Method for Significant Wave Height Forecasts in the Western North Pacific

Recent Advances in China on the Predictability of Weather and Climate

Short- to Medium-Term Sea Surface Height Prediction in the Bohai Sea Using an Optimized Simple Recurrent Unit Deep Network

A Spatiotemporal Deep Neural Network for Fine-Grained Multi-Horizon Wind Prediction

Leveraging data-driven weather models for improving numerical weather prediction skill through large-scale spectral nudging

Spatio-Temporal Wind Speed Prediction Based on Improved Residual Shrinkage Network

Short-range forecasts of global precipitation using deep learning-augmented numerical weather prediction

A Hybrid Model for Long-Term Wind Power Forecasting Utilizing NWP Subsequence Correction and Multi-Scale Deep Learning Regression Methods

A Deep Learning Method for Real-time Bias Correction of Wind Field Forecasts in the Western North Pacific

Long-term instabilities of deep learning-based digital twins of the climate system: The cause and a solution

A new decomposition-ensemble strategy fusion with correntropy optimization learning algorithms for short-term wind speed prediction

Towards a Self-contained Data-driven Global Weather Forecasting Framework

YingLong: Skillful High Resolution Regional Short Term Forecasting with Boundary Smoothing

Hybrid model based on VMD decomposition, clustering analysis, long short memory network, ensemble learning and error complementation for short-term wind speed forecasting assisted by Flink platform

Decomposing weather forecasting into advection and convection with neural networks

Improved extended-range prediction of persistent stratospheric perturbations using machine learning

A novel approach to improve numerical weather prediction skills by using anomaly integration and historical data