Abstract:Rational approximation appears in many contexts throughout science and engineering, playing a central role in linear systems theory, special function approximation, and many others. There are many existing methods for solving the rational approximation problem, from fixed point methods like the Sanathanan-Koerner iteration and Vector Fitting, to partial interpolation methods like Adaptive Anderson Antoulas (AAA). While these methods can often find rational approximations with a small residual norm, they are unable to find optimizers with respect to a weighted l2 norm with a square dense weighting matrix. Here we develop a nonlinear least squares approach constructing rational approximations with respect to this norm. We explore this approach using two parameterizations of rational functions: a ratio of two polynomials and a partial fraction expansion. In both cases, we show how we can use Variable Projection (VARPRO) to reduce the dimension of the optimization problem. As many applications seek a real rational approximation that can be described as a ratio of two real polynomials, we show how this constraint can be enforced in both parameterizations. Although this nonlinear least squares approach often converge to suboptimal local minimizers, we find this can be largely mitigated by initializing the algorithm using the poles of the AAA algorithm applied to the same data. This combination of initialization and nonlinear least squares enables us to construct rational approximants using dense and potentially ill-conditioned weight matrices such as those that appear as a step in new H2 model reduction algorithm recently developed by the authors.

A Rapidly Convergent Iterative Method for the Solution of the Generalised Nonlinear Least Squares Problem

Gradient-based Maximal Convergence Rate Iterative Method for Solving Linear Matrix Equations

Iterative algorithm for minimal norm least squares solution to general linear matrix equations

Least Squares Solution with the Minimum-Norm to General Matrix Equations Via Iteration.

A Generalized Adaptive Levenberg–Marquardt Method for Solving Nonlinear Ill-Posed Problems

A Nonlinear Acceleration Method for Iterative Algorithms

A robust iterative family for multiple roots of nonlinear equations: Enhancing accuracy and handling critical points

A Fast Block Coordinate Descent Method for Solving Linear Least-Squares Problems

Non-intrusive Least-Squares Functional A Posteriori Error Estimator: Linear and Nonlinear Problems with Plain Convergence

High accuracy least-squares solutions of nonlinear differential equations

ON CONVERGENCE OF A TRUNCATED GAUSS-NEWTON METHOD FOR SOLVING UNDERDETERMINED NONLINEAR LEAST SQUARES PROBLEMS

Convergence Properties of an Iterative Method for Solving Symmetric Non-linear Equations

Accelerating iterative solvers via a two-dimensional minimum residual technique

Fast Algorithms for lp-Regression

A Fast Scale-Invariant Algorithm for Non-negative Least Squares with Non-negative Data

A fast numerical algorithm for finding all real solutions to a system of N nonlinear equations in a finite domain

Linearly convergent adjoint free solution of least squares problems by random descent

A Bregman-Kaczmarz method for nonlinear systems of equations

Higher-Order Corrections to Optimisers based on Newton's Method

Randomized Iterative Methods for Linear Systems

Least Squares Rational Approximation