Abstract:The impact of diabatic processes on 4-dimensional variational data assimilation (4D-Var) was studied using the 1995 version of NCEP's global spectral model with and without full physics. The adjoint was coded manually. A cost function measuring spectral errors of 6-hour forecasts to "observation" (the NCEP reanalysis data) was minimized using the L-BFGS (the limited memory quasi-Newton algorithm developed by Broyden, Fletcher, Goldfard and Shanno) for optimizing parameters and initial conditions. Minimization of the cost function constrained by an adiabatic version of the NCEP global model converged to a minimum with a significant amount of decrease in the value of the cost function. Minimization of the cost function using the diabatic model, however, failed after a few iterations due to discontinuities introduced by physical parameterizations. Examination of the convergence of the cost function in different spectral domains reveals that the large-scale flow is adjusted during the first 10 iterations, in which discontinuous diabatic parameterizations play very little role. The adjustment produced by the minimization gradually moves to relatively smaller scales between 10-20th iterations. During this transition period, discontinuities in the cost function produced by "on-off" switches in the physical parameterizations caused the cost function to stay in a shallow local minimum instead of continuously decreasing toward a deeper minimum. Next, a mixed 4D-Var scheme is tested in which large-scale flows are first adiabatically adjusted to a sufficient level, followed by a diabatic adjustment introduced after 10 to 20 iterations. The mixed 4D-Var produced a closer fit of analysis to observations, with 38% and 41% more decrease in the values of the cost function and the norm of gradient, respectively, than the standard diabatic 4D-Var, while the CPU time is reduced by 21%. The resulting optimal initial conditions improve the short-range forecast skills of 48-hour statistics. The detrimental effect of parameterization discontinuities on minimization was also reduced.

Convergent least-squares optimization methods for variational data assimilation

Numerical Solution for Nonlinear 4D Variational Data Assimilation (4D-Var) via ADMM

The Conditioning of Hybrid Variational Data Assimilation

A Time-parallel Approach to Strong-constraint Four-dimensional Variational Data Assimilation

On variational data assimilation in continuous time

Convergence properties of a Gauss-Newton data-assimilation method

Numerical Linear Algebra in Data Assimilation

Introduction to data assimilation for parameter estimation

A Framework for Four-Dimensional Variational Data Assimilation Based on Machine Learning.

An Analysis of 4D Variational Data Assimilation and Its Application

Design and Implementation of Four-Dimensional Variational Data Assimilation System Constrained by the Global Spectral Model

A Four‐Dimensional Variational Constrained Neural Network‐Based Data Assimilation Method

Analytical Four-Dimensional Ensemble Variational Data Assimilation for Joint State and Parameter Estimation

IMPACT OF DIABATIC PROCESSES IN AGCM ON 4-DIMENSIONAL VARIATIONAL DATA ASSIMILATION

A Multiscale Four-Dimensional Variational Data Assimilation Scheme: A Squall-Line Case Study

4D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning models

A scalable space-time domain decomposition approach for solving large-scale nonlinear regularized inverse ill-posed problems in 4D variational data assimilation

On the use of the saddle formulation in weakly-constrained 4D-VAR data assimilation

An Analytical Four‐Dimensional Ensemble‐Variational Data Assimilation Scheme

A Comparison of Two Nonlinear Data Assimilation Methods

Coastal ocean data assimilation using a multi-scale three-dimensional variational scheme