Abstract:Abstract. The development of remote sensing techniques has greatly advanced our knowledge of atmospheric aerosols. Various satellite sensors and the associated retrieval algorithms all add to the information of global aerosol variability, while well-designed surface networks provide time series of highly accurate measurements at specific locations. In studying the variability of aerosol properties, aerosol climate effects, and constraining aerosol fields in climate models, it is essential to make the best use of all of the available information. In the previous three parts of this series, we demonstrated the usefulness of several spectral decomposition techniques in the analysis and comparison of temporal and spatial variability of aerosol optical depth using satellite and ground-based measurements. Specifically, Principal Component Analysis (PCA) successfully captures and isolates seasonal and interannual variability from different aerosol source regions, Maximum Covariance Analysis (MCA) provides a means to verify the variability in one satellite dataset against Aerosol Robotic Network (AERONET) data, and Combined Principal Component Analysis (CPCA) realized parallel comparison among multi-satellite, multi-sensor datasets. As the final part of the study, this paper introduces a novel technique that integrates both multi-sensor datasets and ground observations, and thus effectively bridges the gap between these two types of measurements. The Combined Maximum Covariance Analysis (CMCA) decomposes the cross covariance matrix between the combined multi-sensor satellite data field and AERONET station data. We show that this new method not only confirms the seasonal and interannual variability of aerosol optical depth, aerosol source regions and events represented by different satellite datasets, but also identifies the strengths and weaknesses of each dataset in capturing the variability associated with sources, events or aerosol types. Furthermore, by examining the spread of the spatial modes of different satellite fields, regions with the largest uncertainties in aerosol observation are identified. We also present two regional case studies that respectively demonstrate the capability of the CMCA technique in assessing the representation of an extreme event in different datasets, and in evaluating the performance of different datasets on seasonal and interannual time scales.

Spy4Cast v1.0: a Python Tool for statistical seasonal forecast based on Maximum Covariance Analysis

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models

Lagged teleconnections of climate variables identified via complex rotated Maximum Covariance Analysis

The CAST package for training and assessment of spatial prediction models in R

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Portalcasting: Supporting Automated Forecasting of Rodent Populations

A canonical model for seasonal climate prediction using Big Data

SubseasonalClimateUSA: A Dataset for Subseasonal Forecasting and Benchmarking

TempCast: A Multi-modal Transformer for Short-Term Temperature Forecasting

FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators

Fully Bayesian inference for spatiotemporal data with the multi-resolution approximation

CloudCast -- Total Cloud Cover Nowcasting with Machine Learning

Application of Spectral Analysis Techniques to the Intercomparison of Aerosol Data – Part 4: Combined Maximum Covariance Analysis to Bridge the Gap Between Multi-Sensor Satellite Retrievals and Ground-Based Measurements

CoDiCast: Conditional Diffusion Model for Weather Prediction with Uncertainty Quantification

GraphCast: Learning skillful medium-range global weather forecasting

SGCast: A New Forecasting Framework for Multilocation Geomagnetic Data With Missing Traces Based on Matrix Factorization

RASCAL v1.0: an open-source tool for climatological time series reconstruction and extension

A meteorological analysis interpolation scheme for high spatial-temporal resolution in complex terrain

eco4cast: Bridging Predictive Scheduling and Cloud Computing for Reduction of Carbon Emissions for ML Models Training

W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecasting

SpaCE: The Spatial Confounding Environment