Abstract:Recent advancements in artificial intelligence (AI) for numerical weather prediction (NWP) have significantly transformed atmospheric modeling. AI NWP models outperform traditional physics-based systems, such as the Integrated Forecast System (IFS), across several global metrics while requiring fewer computational resources. However, existing AI NWP models face limitations related to training datasets and timestep choices, often resulting in artifacts that reduce model performance. To address these challenges, we introduce the Community Research Earth Digital Intelligence Twin (CREDIT) framework, developed at NSF NCAR. CREDIT provides a flexible, scalable, and user-friendly platform for training and deploying AI-based atmospheric models on high-performance computing systems. It offers an end-to-end pipeline for data preprocessing, model training, and evaluation, democratizing access to advanced AI NWP capabilities. We demonstrate CREDIT's potential through WXFormer, a novel deterministic vision transformer designed to predict atmospheric states autoregressively, addressing common AI NWP issues like compounding error growth with techniques such as spectral normalization, padding, and multi-step training. Additionally, to illustrate CREDIT's flexibility and state-of-the-art model comparisons, we train the FUXI architecture within this framework. Our findings show that both FUXI and WXFormer, trained on six-hourly ERA5 hybrid sigma-pressure levels, generally outperform IFS HRES in 10-day forecasts, offering potential improvements in efficiency and forecast accuracy. CREDIT's modular design enables researchers to explore various models, datasets, and training configurations, fostering innovation within the scientific community.

AI2ES: The NSF AI Institute for Research on Trustworthy AI for Weather, Climate, and Coastal Oceanography

Trustworthy Artificial Intelligence for Environmental Sciences: An Innovative Approach for Summer School

Trust and trustworthy artificial intelligence: A research agenda for AI in the environmental sciences

Developing trustworthy AI for weather and climate

The Need for Ethical, Responsible, and Trustworthy Artificial Intelligence for Environmental Sciences

Cybertrust: From Explainable to Actionable and Interpretable AI (AI2)

Creating intelligent cyberinfrastructure for democratizing AI

Athena – The NSF AI Institute for Edge Computing

AAAI FSS-19: Human-Centered AI: Trustworthiness of AI Models and Data Proceedings

Why we need to focus on developing ethical, responsible, and trustworthy artificial intelligence approaches for environmental science

Artificial intelligence and machine learning in dynamic cyber risk analytics at the edge

Trustworthy and Responsible AI for Human-Centric Autonomous Decision-Making Systems

Community Research Earth Digital Intelligence Twin (CREDIT)

Artificial Intelligence Revolutionises Weather Forecast, Climate Monitoring and Decadal Prediction

AI Institute in Dynamic Systems: Developing machine learning and AI tools for scientific discovery, engineering design, and data‐driven control

Proceedings of AAAI 2022 Fall Symposium: The Role of AI in Responding to Climate Challenges

AI for Open Science: A Multi-Agent Perspective for Ethically Translating Data to Knowledge

The AI Institute for Engaged Learning

Responsible AI for Earth Observation

Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Society