Abstract:PurposeThe purpose of this paper is to present a novel gradient‐based iterative algorithm for the joint diagonalization of a set of real symmetric matrices. The approximate joint diagonalization of a set of matrices is an important tool for solving stochastic linear equations. As an application, reliability analysis of structures by using the stochastic finite element analysis based on the joint diagonalization approach is also introduced in this paper, and it provides useful references to practical engineers.Design/methodology/approachBy starting with a least squares (LS) criterion, the authors obtain a classical nonlinear cost‐function and transfer the joint diagonalization problem into a least squares like minimization problem. A gradient method for minimizing such a cost function is derived and tested against other techniques in engineering applications.FindingsA novel approach is presented for joint diagonalization for a set of real symmetric matrices. The new algorithm works on the numerical gradient base, and solves the problem with iterations. Demonstrated by examples, the new algorithm shows the merits of simplicity, effectiveness, and computational efficiency.Originality/valueA novel algorithm for joint diagonalization of real symmetric matrices is presented in this paper. The new algorithm is based on the least squares criterion, and it iteratively searches for the optimal transformation matrix based on the gradient of the cost function, which can be computed in a closed form. Numerical examples show that the new algorithm is efficient and robust. The new algorithm is applied in conjunction with stochastic finite element methods, and very promising results are observed which match very well with the Monte Carlo method, but with higher computational efficiency. The new method is also tested in the context of structural reliability analysis. The reliability index obtained with the joint diagonalization approach is compared with the conventional Hasofer Lind algorithm, and again good agreement is achieved.

A structured diagonal Hessian approximation method with evaluation complexity analysis for nonlinear least squares

A Novel Joint Diagonalization Approach for Linear Stochastic Systems and Reliability Analysis

Scalable Subspace Methods for Derivative-Free Nonlinear Least-Squares Optimization

Nonlinear Least Squares for Large-Scale Machine Learning using Stochastic Jacobian Estimates

An Efficient Iterative Approach to Large Sparse Nonlinear Systems with Non-Hermitian Jacobian Matrices

A new approximate descent derivative-free algorithm for large-scale nonlinear symmetric equations

A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained Optimization

An Efficient Modified Residual-Based Algorithm for Large Scale Symmetric Nonlinear Equations by Approximating Successive Iterated Gradients

A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

A Quadratically Convergent Algorithm for Structured Low-Rank Approximation

A matrix algebra approach to approximate Hessians

A Joint Diagonalisation Approach for Linear Stochastic Systems

Sequential alternating least squares for solving high dimensional linear Hamilton-Jacobi-Bellman equation

A method to guarantee local convergence for sequential quadratic programming with poor Hessian approximation

Structured Quasi-Newton Methods for Optimization with Orthogonality Constraints.

A Modified Dai–Liao Conjugate Gradient Method Based on a Scalar Matrix Approximation of Hessian and Its Application

A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

Structured BFGS Method for Optimal Doubly Stochastic Matrix Approximation.

A structured L-BFGS method with diagonal scaling and its application to image registration

Two-Step Fifth-Order Efficient Jacobian-Free Iterative Method for Solving Nonlinear Systems

An efficient sieving based secant method for sparse optimization problems with least-squares constraints