Abstract:A finite element methodology for large classes of variational boundary value problems is defined which involves discretizing two linear operators: (1) the differential operator defining the spatial boundary value problem; and (2) a Riesz map on the test space. The resulting linear system is overdetermined. Two different approaches for solving the system are suggested (although others are discussed): (1) solving the associated normal equation with linear solvers for symmetric positive-definite systems (e.g. Cholesky factorization); and (2) solving the overdetermined system with orthogonalization algorithms (e.g. QR factorization). The finite element assembly algorithm for each of these approaches is described in detail. The normal equation approach is usually faster for direct solvers and requires less storage. The second approach reduces the condition number of the system by a power of two and is less sensitive to round-off error. The rectangular stiffness matrix of second approach is demonstrated to have condition number $\mathcal{O}(h^{-1})$ for a variety of formulations of Poisson's equation. The stiffness matrix from the normal equation approach is demonstrated to be related to the monolithic stiffness matrices of least-squares finite element methods and it is proved that the two are identical in some cases. An example with Poisson's equation indicates that the solutions of these two different linear systems can be nearly indistinguishable (if round-off error is not an issue) and rapidly converge to each other. The orthogonalization approach is suggested to be beneficial for problems which induce poorly conditioned linear systems. Experiments with Poisson's equation in single-precision arithmetic as well as the linear acoustics problem near resonance in double-precision arithmetic verify this conclusion.

An Arnoldi-based approach to polynomial and rational least squares problems

Least Squares Rational Approximation

Computing $f(A)b$ via Least Squares Polynomial Approximations

Accurate Polynomial Fitting and Evaluation Via Arnoldi

Vandermonde with Arnoldi

Krylov Subspace Methods for the Generalized Sylvester Equation.

Second-order Krylov Subspace and Arnoldi Procedure

Multivariate confluent Vandermonde with G-Arnoldi and applications

Sketched and Truncated Polynomial Krylov Subspace Methods: Matrix Sylvester Equations

A Semiorthogonal Generalized Arnoldi Method And Its Variations For Quadratic Eigenvalue Problems

A rational conjugate gradient method for linear ill-conditioned problems

Least squares solutions of bilinear equations

Nearly Optimal Approximation of Matrix Functions by the Lanczos Method

Optimal Randomized First-Order Methods for Least-Squares Problems

Sketched and truncated polynomial Krylov methods: Evaluation of matrix functions

SOAR: A Second-order Arnoldi Method for the Solution of the Quadratic Eigenvalue Problem.

Improving eigenvectors in Arnoldi's method

A Sherman--Morrison--Woodbury approach to solving least squares problems with low-rank updates

Discrete least-squares finite element methods

Randomized Extended Kaczmarz for Solving Least-Squares

Total positivity and least squares problems in the Lagrange basis