Evaluation of ENSO Prediction Skill Changes since 2000 Based on Multimodel Hindcasts

Shouwen Zhang,Hui Wang,Hua Jiang,Wentao Ma
DOI: https://doi.org/10.3390/atmos12030365
IF: 3.11
2021-03-10
Atmosphere
Abstract:In this study, forecast skill over four different periods of global climate change (1982–1999, 1984–1996, 2000–2018, and 2000–2014) is examined using the hindcasts of five models in the North American Multimodel Ensemble. The deterministic evaluation shows that the forecasting skills of the Niño3.4 and Niño3 indexes are much lower during 2000–2018 than during 1982–1999, indicating that the previously reported decline in forecasting skill continues through 2018. The decreases in skill are most significant for the target months from May to August, especially for medium to long lead times, showing that the forecasts suffer more from the effect of the spring predictability barrier (SPB) post-2000. Relationships between the extratropical Pacific signal and the El Niño-Southern Oscillation (ENSO) weakened after 2000, contributing to a reduction in inherent predictability and skills of ENSO, which may be connected with the forecasting skills decline for medium to long lead times. It is a great challenge to predict ENSO using the memory of the local ocean itself because of the weakening intensity of the warm water volume (WWV) and its relationship with ENSO. These changes lead to a significant decrease in the autocorrelation coefficient of the persistence forecast for short to medium lead months. Moreover, for both the Niño3.4 and Niño3 indexes, after 2000, the models tend to further underestimate the sea surface temperature anomalies (SSTAs) in the El Niño developing year but overestimate them in the decaying year. For the probabilistic forecast, the skills post-2000 are also generally lower than pre-2000 in the tropical Pacific, and in particular, they decayed east of 120° W after 2000. Thus, the advantages of different methods, such as dynamic modeling, statistical methods, and machine learning methods, should be integrated to obtain the best applicability to ENSO forecasts and to deal with the current low forecasting skill phenomenon.
environmental sciences,meteorology & atmospheric sciences
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the changes in El Niño - Southern Oscillation (ENSO) prediction skills since 2000. Specifically, the study analyzed the changes in ENSO prediction skills in four different time periods: 1982 - 1999, 1984 - 1996, 2000 - 2018, and 2000 - 2014, by using the hindcast data of five models in the North American Multi - Model Ensemble. The study focused on the skill changes in deterministic and probabilistic predictions, as well as the reasons behind these changes, especially exploring the phenomenon of the decline in ENSO prediction skills and its possible influencing factors. ### Main research questions: 1. **Changes in ENSO prediction skills**: Evaluate the changes in ENSO prediction skills since 2000, especially the differences in prediction skills in different time periods (1982 - 1999, 1984 - 1996, 2000 - 2018, and 2000 - 2014). 2. **Reasons for the decline in prediction skills**: Explore the main reasons for the decline in ENSO prediction skills, including the spring predictability barrier (SPB), the weakening of the relationship between signals outside the tropical Pacific and ENSO, the variability of warm water volume (WWV) and the weakening of its relationship with ENSO, etc. 3. **Integration of the advantages of different prediction methods**: Study how to integrate the advantages of dynamic modeling, statistical methods, and machine - learning methods to improve the applicability of ENSO prediction and deal with the current phenomenon of low prediction skills. ### Research background: - **Importance of ENSO**: ENSO is the most important inter - annual variation pattern in the tropical Pacific air - sea coupled system and has a significant impact on global weather and climate. - **Historical changes in prediction skills**: Although significant progress has been made in ENSO prediction in the past few decades, there is increasing evidence that since 2000, ENSO prediction skills have declined compared to those before 2000. - **Possible reasons for the decline in prediction skills**: Including the weakening of the inter - annual variability in the tropical Pacific, the variability of warm water volume (WWV) and the weakening of its relationship with ENSO, the weakening of the relationship between signals outside the tropical Pacific and ENSO, etc. ### Research methods: - **Data sources**: Use the hindcast data of five models in the North American Multi - Model Ensemble (NMME). - **Evaluation indicators**: Through the skill evaluation of deterministic and probabilistic predictions, including the temporal anomaly correlation coefficient, Brier skill score, etc. - **Analysis methods**: Compare the changes in prediction skills in different time periods, analyze the reasons for the decline in prediction skills, and explore the integration of the advantages of different prediction methods. ### Research results: - **Changes in prediction skills**: The ENSO prediction skills after 2000 are significantly lower than those before 2000, especially in the medium - and long - term prediction periods. - **Spring predictability barrier (SPB)**: After 2000, the impact of SPB on prediction skills is more significant. - **Signals outside the tropical Pacific**: After 2000, the relationship between signals outside the tropical Pacific and ENSO has weakened, resulting in a decline in the inherent predictability and prediction skills of ENSO. - **Warm water volume (WWV)**: After 2000, the variability of WWV and its relationship with ENSO have weakened, further affecting the prediction skills of ENSO. - **Advantages of different prediction methods**: It is recommended to integrate the advantages of dynamic modeling, statistical methods, and machine - learning methods to improve the applicability of ENSO prediction and deal with the current phenomenon of low prediction skills. ### Conclusion: This study reveals the significant decline in ENSO prediction skills since 2000 and explores the reasons behind it. The research results emphasize the importance of integrating the advantages of different prediction methods to improve the accuracy and reliability of ENSO prediction.