On the Raleigh-Ritz variational method. Non-orthogonal basis set

Francisco M. Fernández

2024-05-15

Abstract:We overview the main equations of the Rayleigh-Ritz variational method and discuss their connection with the problem of simultaneous diagonalization of two Hermitian matrices.

Quantum Physics

What problem does this paper attempt to address?

Rayleigh-Ritz variational method with suitable asymptotic behaviour

Javier Garcia,Francisco M Fernández

DOI: https://doi.org/10.48550/arXiv.1308.0001

2013-07-31

Abstract:We discuss Rayleigh-Ritz variational calculations with nonorthogonal basis sets that exhibit the correct asymptotic behaviour. We construct the suitable basis sets for general one-dimensional models and illustrate the application of the approach on two double-well oscillators proposed recently by other authors. The rate of convergence of the variational method proves to be considerably greater than the one exhibited by the recently developed orthogonal polynomial projection quantization.

Mathematical Physics
On the Rayleigh-Ritz variational method

Francisco M. Fernández

2023-11-06

Abstract:We give a simple proof of the well known fact that the approximate eigenvalues provided by the Rayleigh-Ritz variational method are increasingly accurate upper bounds to the exact ones. To this end, we resort to the variational principle, mentioned in most textbooks on quantum chemistry, and to a well known set of projection operators. We think that present approach may be suitable for an advanced course on quantum mechanics or quantum chemistry.

Quantum Physics
On the application of the Rayleigh-Ritz method to a projected Hamiltonian

Francisco M. Fernández

2024-11-20

Abstract:We apply the well known Rayleigh-Ritz method (RRM) to the projection of a Hamiltonian operator chosen recently for the extension of the variational principle to ensemble states. By means of a toy model we show that the RRM eigenvalues approach to those of the projected Hamiltonian from below.

Quantum Physics
On the variational treatment of a class of double-well oscillators

Francisco M. Fernández,Javier Garcia

2023-08-17

Abstract:We compare the well known Rayleigh-Ritz variational method (RRVM) with a recently proposed approach based on supersymmetric quantum mechanics and the Gram-Schmidt orthogonalization method (SSQMGS). We apply both procedures to a particular class of double-well harmonic oscillators that had been conveniently chosen for the application of the latter approach. The RRVM eigenvalues converge smoothly from above providing much more accurate results with less computational effort. Present results show that the unproved SSQMGS upper bounds do not hold.

Quantum Physics
Rayleigh-Ritz majorization error bounds with applications to FEM

Andrew V. Knyazev,Merico E. Argentati

DOI: https://doi.org/10.1137/08072574X

2009-10-06

Abstract:The Rayleigh-Ritz (RR) method finds the stationary values, called Ritz values, of the Rayleigh quotient on a given trial subspace as approximations to eigenvalues of a Hermitian operator $A$. If the trial subspace is $A$-invariant, the Ritz values are exactly some of the eigenvalues of $A$. Given two subspaces $\X$ and $\Y$ of the same finite dimension, such that $\X$ is $A$-invariant, the absolute changes in the Ritz values of $A$ with respect to $\X$ compared to the Ritz values with respect to $\Y$ represent the RR absolute eigenvalue approximation error. Our first main result is a sharp majorization-type RR error bound in terms of the principal angles between $\X$ and $\Y$ for an arbitrary $A$-invariant $\X$, which was a conjecture in [SIAM J. Matrix Anal. Appl., 30 (2008), pp. 548-559]. Second, we prove a novel type of RR error bound that deals with the products of the errors, rather than the sums. Third, we establish majorization bounds for the relative errors. We extend our bounds to the case $\dim\X\leq\dim\Y<\infty$ in Hilbert spaces and apply them in the context of the finite element method.

Numerical Analysis
An Analysis of the Rayleigh-Ritz Method for Approximating Eigenspaces

ZX Jia,GW Stewart

DOI: https://doi.org/10.1090/s0025-5718-00-01208-4

IF: 2.118

2000-01-01

Mathematics of Computation

Abstract:This paper concerns the Rayleigh-Ritz method for computing an approximation to an eigenspace X of a general matrix A from a subspace W that contains an approximation to X. The method produces a pair (N, (X) over tilde) that purports to approximate a pair (L, X), where X is a basis for X and AX = XL. In this paper we consider the convergence of (N, (X) over tilde) as the sine epsilon of the angle between X and W approaches zero. It is shown that under a natural hypothesis - called the uniform separation condition - the Ritz pairs (N, (X) over tilde) converge to the eigenpair (L, X). When one is concerned with eigenvalues and eigenvectors, one can compute certain refined Ritz vectors whose convergence is guaranteed, even when the uniform separation condition is not satisfied. An attractive feature of the analysis is that it does not assume that A has distinct eigenvalues or is diagonalizable.
On two different kinds of resonances in one-dimensional quantum-mechanical models

Francisco M. Fernández,Javier Garcia

DOI: https://doi.org/10.48550/arXiv.1604.08444

2016-05-18

Abstract:We apply the Riccati-Padé method and the Rayleigh-Ritz method with complex rotation to the study of the resonances of a one-dimensional well with two barriers. The model exhibits two different kinds of resonances and we calculate them by means of both approaches. While the Rayleigh-Ritz method reveals each set at a particular interval of rotation angles the Riccati Padé method yields both of them as roots of the same Hankel determinants.

Quantum Physics
On the Convergence of Ritz Pairs and Refined Ritz Vectors for Quadratic Eigenvalue Problems

Tsung-Ming Huang,Zhongxiao Jia,Wen-Wei Lin

DOI: https://doi.org/10.1007/s10543-013-0438-0

2015-03-16

Abstract:For a given subspace, the Rayleigh-Ritz method projects the large quadratic eigenvalue problem (QEP) onto it and produces a small sized dense QEP. Similar to the Rayleigh-Ritz method for the linear eigenvalue problem, the Rayleigh-Ritz method defines the Ritz values and the Ritz vectors of the QEP with respect to the projection subspace. We analyze the convergence of the method when the angle between the subspace and the desired eigenvector converges to zero. We prove that there is a Ritz value that converges to the desired eigenvalue unconditionally but the Ritz vector converges conditionally and may fail to converge. To remedy the drawback of possible non-convergence of the Ritz vector, we propose a refined Ritz vector that is mathematically different from the Ritz vector and is proved to converge unconditionally. We construct examples to illustrate our theory.

Numerical Analysis
Solving Non-Linear Fractional Variational Problems Using Jacobi Polynomials

Harendra Singh,Rajesh K. Pandey,Hari Mohan Srivastava

DOI: https://doi.org/10.3390/math7030224

IF: 2.4

2019-01-01

Mathematics

Abstract:The aim of this paper is to solve a class of non-linear fractional variational problems (NLFVPs) using the Ritz method and to perform a comparative study on the choice of different polynomials in the method. The Ritz method has allowed many researchers to solve different forms of fractional variational problems in recent years. The NLFVP is solved by applying the Ritz method using different orthogonal polynomials. Further, the approximate solution is obtained by solving a system of nonlinear algebraic equations. Error and convergence analysis of the discussed method is also provided. Numerical simulations are performed on illustrative examples to test the accuracy and applicability of the method. For comparison purposes, different polynomials such as 1) Shifted Legendre polynomials, 2) Shifted Chebyshev polynomials of the first kind, 3) Shifted Chebyshev polynomials of the third kind, 4) Shifted Chebyshev polynomials of the fourth kind, and 5) Gegenbauer polynomials are considered to perform the numerical investigations in the test examples. Further, the obtained results are presented in the form of tables and figures. The numerical results are also compared with some known methods from the literature.
The Rayleigh–Ritz method, refinement and Arnoldi process for periodic matrix pairs

Eric King-Wah Chu,Hung-Yuan Fan,Zhongxiao Jia,Tiexiang Li,Wen-Wei Lin

DOI: https://doi.org/10.1016/j.cam.2010.11.014

IF: 2.872

2011-01-01

Journal of Computational and Applied Mathematics

Abstract:We extend the Rayleigh–Ritz method to the eigen-problem of periodic matrix pairs. Assuming that the deviations of the desired periodic eigenvectors from the corresponding periodic subspaces tend to zero, we show that there exist periodic Ritz values that converge to the desired periodic eigenvalues unconditionally, yet the periodic Ritz vectors may fail to converge. To overcome this potential problem, we minimize residuals formed with periodic Ritz values to produce the refined periodic Ritz vectors, which converge under the same assumption. These results generalize the corresponding well-known ones for Rayleigh–Ritz approximations and their refinement for non-periodic eigen-problems. In addition, we consider a periodic Arnoldi process which is particularly efficient when coupled with the Rayleigh–Ritz method with refinement. The numerical results illustrate that the refinement procedure produces excellent approximations to the original periodic eigenvectors.
Uniform convergence guarantees for the deep Ritz method for nonlinear problems

Patrick Dondl,Johannes Müller,Marius Zeinhofer

DOI: https://doi.org/10.1186/s13662-022-03722-8

2022-07-16

Advances in Continuous and Discrete Models

Abstract:We provide convergence guarantees for the Deep Ritz Method for abstract variational energies. Our results cover nonlinear variational problems such as the p -Laplace equation or the Modica–Mortola energy with essential or natural boundary conditions. Under additional assumptions, we show that the convergence is uniform across bounded families of right-hand sides.
Separable Resolution-of-the-Identity with All-Electron Gaussian Bases: Application to Cubic-scaling RPA

Ivan Duchemin,Xavier Blase

DOI: https://doi.org/10.1063/1.5090605

2019-02-01

Abstract:We explore a separable resolution-of-the-identity formalism built on quadratures over limited sets of real-space points designed for all-electron calculations. Our implementation preserves in particular the use of common atomic orbitals and their related auxiliary basis sets. The set up of the present density fitting scheme, i.e. the calculation of the system specific quadrature weights, scales cubically with respect to the system size. Extensive accuracy tests are presented for the Fock exchange and MP2 correlation energies. We finally demonstrate random phase approximation (RPA) correlation energy calculations with a scaling that is cubic in terms of operations, quadratic in memory, with a small crossover with respect to our standard RI-RPA implementation.

Chemical Physics,Materials Science,Computational Physics
A Riemann-Hilbert problem for biorthogonal polynomials

A. B. J. Kuijlaars,K. T-R McLaughlin

DOI: https://doi.org/10.48550/arXiv.math/0310204

2003-10-14

Abstract:We characterize the biorthogonal polynomials that appear in the theory of coupled random matrices via a Riemann-Hilbert problem. Our Riemann-Hilbert problem is different from the ones that were proposed recently by Ercolani and McLaughlin, Kapaev, and Bertola et al. We believe that our formulation may be tractable to asymptotic analysis.

Complex Variables,Mathematical Physics
Randomized Implicitly Restarted Arnoldi method for the non-symmetric eigenvalue problem

Jean-Guillaume de Damas,Laura Grigori

2024-07-03

Abstract:In this paper, we introduce a randomized algorithm for solving the non-symmetric eigenvalue problem, referred to as randomized Implicitly Restarted Arnoldi (rIRA). This method relies on using a sketch-orthogonal basis during the Arnoldi process while maintaining the Arnoldi relation and exploiting a restarting scheme to focus on a specific part of the spectrum. We analyze this method and show that it retains useful properties of the Implicitly Restarted Arnoldi (IRA) method, such as restarting without adding errors to the Ritz pairs and implicitly applying polynomial filtering. Experiments are presented to validate the numerical efficiency of the proposed randomized eigenvalue solver.

Numerical Analysis
Angles Between Infinite Dimensional Subspaces with Applications to the Rayleigh-Ritz and Alternating Projectors Methods

Andrew Knyazev,Abram Jujunashvili,Merico Argentati

DOI: https://doi.org/10.1016/j.jfa.2010.05.018

2010-06-02

Abstract:We define angles from-to and between infinite dimensional subspaces of a Hilbert space, inspired by the work of E. J. Hannan, 1961/1962 for general canonical correlations of stochastic processes. The spectral theory of selfadjoint operators is used to investigate the properties of the angles, e.g., to establish connections between the angles corresponding to orthogonal complements. The classical gaps and angles of Dixmier and Friedrichs are characterized in terms of the angles. We introduce principal invariant subspaces and prove that they are connected by an isometry that appears in the polar decomposition of the product of corresponding orthogonal projectors. Point angles are defined by analogy with the point operator spectrum. We bound the Hausdorff distance between the sets of the squared cosines of the angles corresponding to the original subspaces and their perturbations. We show that the squared cosines of the angles from one subspace to another can be interpreted as Ritz values in the Rayleigh-Ritz method, where the former subspace serves as a trial subspace and the orthogonal projector of the latter subspace serves as an operator in the Rayleigh-Ritz method. The Hausdorff distance between the Ritz values, corresponding to different trial subspaces, is shown to be bounded by a constant times the gap between the trial subspaces. We prove a similar eigenvalue perturbation bound that involves the gap squared. Finally, we consider the classical alternating projectors method and propose its ultimate acceleration, using the conjugate gradient approach. The corresponding convergence rate estimate is obtained in terms of the angles. We illustrate a possible acceleration for the domain decomposition method with a small overlap for the 1D diffusion equation.

Numerical Analysis,Functional Analysis
Semiclassical orthogonal polynomials on the unit circle: A Riemann-Hilbert perspective

Amí lcar Branquinho,Ana Foulquié-Moreno,Karina Rampazzi

2024-06-11

Abstract:In this work we apply Riemann-Hilbert problem to study two families of orthogonal polynomials on the unit circle, named of modified Jacobi and Bessel. We derive first and second order differential equations, for these families of orthogonal polynomials and functions of second kind, as well as nonlinear equations that the Verblunsky coefficients satisfy.

Classical Analysis and ODEs
Convergence of Q-Ritz Pairs, Refined Q-Ritz Vectors and Q-Rayleigh-ritz Method for Quadratic Eigenvalue Problems

Tsung-Ming Huang,Zhongxiao Jia,Wen‐Wei Lin

2011-01-01

Abstract:For a given subspace, the Rayleigh-Ritz method projects the large quadratic eigenvalue problem (QEP) onto it and produces a small sized dense QEP. Similar to the Rayleigh-Ritz method for the linear eigenvalue problem, the Rayleigh-Ritz method defines the Ritz values and the Ritz vectors of the QEP with respect to the projection subspace. We analyze the convergence of the method when the angle between the subspace and the desired eigenvector converges to zero. We prove that there is a Ritz value that converges to the desired eigenvalue unconditionally but the Ritz vector converges conditionally and may fail to converge. To remedy the drawback of possible non-convergence of the Ritz vector, we propose a refined Ritz vector that is mathematically different from the Ritz vector and is proved to converge unconditionally. We construct examples to illustrate our theory.
A Riemann--Hilbert approach to the perturbation theory for orthogonal polynomials: Applications to numerical linear algebra and random matrix theory

Xiucai Ding,Thomas Trogdon

DOI: https://doi.org/10.48550/arXiv.2112.12354

2022-09-22

Abstract:We establish a new perturbation theory for orthogonal polynomials using a Riemann--Hilbert approach and consider applications in numerical linear algebra and random matrix theory. This new approach shows that the orthogonal polynomials with respect to two measures can be effectively compared using the difference of their Stieltjes transforms on a suitably chosen contour. Moreover, when two measures are close and satisfy some regularity conditions, we use the theta functions of a hyperelliptic Riemann surface to derive explicit and accurate expansion formulae for the perturbed orthogonal polynomials. In contrast to other approaches, a key strength of the methodology is that estimates can remain valid as the degree of the polynomial grows. The results are applied to analyze several numerical algorithms from linear algebra, including the Lanczos tridiagonalization procedure, the Cholesky factorization and the conjugate gradient algorithm. As a case study, we investigate these algorithms applied to a general spiked sample covariance matrix model by considering the eigenvector empirical spectral distribution and its limits. For the first time, we give precise estimates on the output of the algorithms, applied to this wide class of random matrices, as the number of iterations diverges. In this setting, beyond the first order expansion, we also derive a new mesoscopic central limit theorem for the associated orthogonal polynomials and other quantities relevant to numerical algorithms.

Probability,Mathematical Physics,Numerical Analysis
A Refined Subspace Iteration Algorithm For Large Sparse Eigenproblems

Zx Jia

DOI: https://doi.org/10.1016/S0168-9274(99)00008-2

IF: 2.994

2000-01-01

Applied Numerical Mathematics

Abstract:Two innovations are presented to improve the orthogonal subspace iteration. Firstly, a refined strategy is proposed that replaces conventional Ritz vectors by refined Ritz vectors in subspace iteration. Each refined Ritz vector is chosen such that the norm of the residual formed with the Ritz value is minimized over the subspace involved, and it can be cheaply computed by solving a small problem. Secondly, a standard updating matrix, Ritz vector or Schur vector matrix, is replaced by a new one that is generated only by the refined Ritz vectors used to approximate the wanted eigenvectors. A combination of them yields a refined subspace iteration algorithm. A qualitative analysis is given for the refined algorithm, showing that it may be considerably more efficient than a conventional subspace iteration algorithm. When the subspace dimension is bigger than the number of the wanted eigenpairs, numerical examples show that the refined algorithm has a sharp superiority. Numerical comparisons are also drawn for the refined algorithm with the popular package ARPACK and an implicitly restarted version of the refined Arnoldi method. The algorithm is suited for computing a few dominant eigenpairs of large sparse matrices since the only action of a matrix A in question into the program is a subroutine to form the product A Q, where Q is a matrix having much less columns than rows. (C) 2000 IMACS. Published by Elsevier Science B.V. All rights reserved.
Riemannian Optimization and the Hartree-Fock Method

Caio O. da Silva

2024-03-22

Abstract:In the present work we studied a subfield of Applied Mathematics called Riemannian Optimization. The main goal of this subfield is to generalize algorithms, theorems and tools from Mathematical Optimization to the case in which the optimization problem is defined on a Riemannian manifold. As a case study, we implemented some of the main algorithms described in the literature (Gradient Descent, Newton-Raphson and Conjugate Gradient) to solve an optimization problem known as Hartree-Fock. This method is extremely important in the field of Computational Quantum Chemistry and it is a good case study because it is a problem somewhat hard to solve and, as a consequence of this, it requires many tools from Riemannian Optimization. Besides, it is also a good example to see how these algorithms perform in practice.

Optimization and Control,Numerical Analysis

On the Raleigh-Ritz variational method. Non-orthogonal basis set

Rayleigh-Ritz variational method with suitable asymptotic behaviour

On the Rayleigh-Ritz variational method

On the application of the Rayleigh-Ritz method to a projected Hamiltonian

On the variational treatment of a class of double-well oscillators

Rayleigh-Ritz majorization error bounds with applications to FEM

An Analysis of the Rayleigh-Ritz Method for Approximating Eigenspaces

On two different kinds of resonances in one-dimensional quantum-mechanical models

On the Convergence of Ritz Pairs and Refined Ritz Vectors for Quadratic Eigenvalue Problems

Solving Non-Linear Fractional Variational Problems Using Jacobi Polynomials

The Rayleigh–Ritz method, refinement and Arnoldi process for periodic matrix pairs

Uniform convergence guarantees for the deep Ritz method for nonlinear problems

Separable Resolution-of-the-Identity with All-Electron Gaussian Bases: Application to Cubic-scaling RPA

A Riemann-Hilbert problem for biorthogonal polynomials

Randomized Implicitly Restarted Arnoldi method for the non-symmetric eigenvalue problem

Angles Between Infinite Dimensional Subspaces with Applications to the Rayleigh-Ritz and Alternating Projectors Methods

Semiclassical orthogonal polynomials on the unit circle: A Riemann-Hilbert perspective

Convergence of Q-Ritz Pairs, Refined Q-Ritz Vectors and Q-Rayleigh-ritz Method for Quadratic Eigenvalue Problems

A Riemann--Hilbert approach to the perturbation theory for orthogonal polynomials: Applications to numerical linear algebra and random matrix theory

A Refined Subspace Iteration Algorithm For Large Sparse Eigenproblems

Riemannian Optimization and the Hartree-Fock Method