Abstract:In this work we solve, for given bounded operators $B,C$ and Hilbert--Schmidt operator $M$ acting on potentially infinite-dimensional separable Hilbert spaces, the reduced rank approximation problem, $\text{min}\{\Vert{M-BXC}\Vert_{HS}:\ \text{dim}\ \text{ran}(X)\leq r\}$. This extends the result of Sondermann (Statistische Hefte, 1986) and Friedland and Torokhti (SIAM J. Matrix Analysis and Applications, 2007), which studies this problem in the case of matrices $M$, $B$, $C$, $X$, and the analysis involves the Moore-Penrose inverse. In classical approximation problems that can be solved by the singular value decomposition or Moore--Penrose inverse, the solution satisfies a minimal norm property. Friedland and Torokhti also state such a minimal norm property of the solution. However, we show that this minimal norm property does not hold in general and give a modified minimality property that is satisfied in general. We also show that the solution may be discontinuous in infinite-dimensional settings. Necessary and sufficient conditions for continuity of the solutions are given and continuous approximations are constructed when such conditions are not met. Finally, we study problems from signal processing, reduced rank regression and linear operator learning under a rank constraint. We show that our theoretical results enable us to explicitly find the solutions to these problems and to fully characterise their existence, uniqueness and minimality property.

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Adaptive Low-Rank Methods: Problems on Sobolev Spaces

Dynamical low-rank tensor approximations to high-dimensional parabolic problems: existence and convergence of spatial discretizations

Low-rank approximate inverse for preconditioning tensor-structured linear systems

A literature survey of low-rank tensor approximation techniques

Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

Subspace Methods with Local Refinements for Eigenvalue Computation Using Low-Rank Tensor-Train Format.

Collocation methods for nonlinear differential equations on low-rank manifolds

A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems

Solving a Class of Infinite-Dimensional Tensor Eigenvalue Problems by Translational Invariant Tensor Ring Approximations

Low-rank solutions to the stochastic Helmholtz equation

Solving differential Riccati equations: A nonlinear space-time method using tensor trains

A Quadratically Convergent Algorithm for Structured Low-Rank Approximation

Generalised rank-constrained approximations of Hilbert-Schmidt operators on separable Hilbert spaces and applications

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

Low-Rank Approximations with Sparse Factors I: Basic Algorithms and Error Analysis

A model reduction approach for inverse problems with operator valued data

Decomposition of linear tensor transformations

Measurability and continuity of parametric low-rank approximation in Hilbert spaces: linear operators and random variables

Low Rank Tensor Decompositions and Approximations