Abstract:In this work we solve, for given bounded operators $B,C$ and Hilbert--Schmidt operator $M$ acting on potentially infinite-dimensional separable Hilbert spaces, the reduced rank approximation problem, $\text{min}\{\Vert{M-BXC}\Vert_{HS}:\ \text{dim}\ \text{ran}(X)\leq r\}$. This extends the result of Sondermann (Statistische Hefte, 1986) and Friedland and Torokhti (SIAM J. Matrix Analysis and Applications, 2007), which studies this problem in the case of matrices $M$, $B$, $C$, $X$, and the analysis involves the Moore-Penrose inverse. In classical approximation problems that can be solved by the singular value decomposition or Moore--Penrose inverse, the solution satisfies a minimal norm property. Friedland and Torokhti also state such a minimal norm property of the solution. However, we show that this minimal norm property does not hold in general and give a modified minimality property that is satisfied in general. We also show that the solution may be discontinuous in infinite-dimensional settings. Necessary and sufficient conditions for continuity of the solutions are given and continuous approximations are constructed when such conditions are not met. Finally, we study problems from signal processing, reduced rank regression and linear operator learning under a rank constraint. We show that our theoretical results enable us to explicitly find the solutions to these problems and to fully characterise their existence, uniqueness and minimality property.

-metric function in the problem of minimization of functionals

Metric Approximation of Set-Valued Functions of Bounded Variation by Integral Operators

Metrically differentiable set-valued functions and their local linear approximants

Discrete Approximation of Optimal Transport on Compact Spaces

On Nonlinear Simultaneous Approximation Problems

On Best Approximation by Nonconvex Sets and Perturbation of Nonconvex Inequality Systems in Hilbert Spaces.

On best restricted range approximation in continuouscomplex-valued function spaces

On Best Simultaneous Approximation

Hilbert's projective metric for functions of bounded growth and exponential convergence of Sinkhorn's algorithm

Metric Fourier approximation of set-valued functions of bounded variation

The pointwise limit of metric integral operators approximating set-valued functions

The minimizer of the sum of two strongly convex functions

A Metric Fixed Point Theorem and Some of Its Applications

On the Set of Possible Minimizers of a Sum of Convex Functions

Generalised rank-constrained approximations of Hilbert-Schmidt operators on separable Hilbert spaces and applications

Subinvariant metric functionals for nonexpansive mappings

Metric extrapolation in the Wasserstein space

Miscellaneous applications of certain minimax theorems II

Approximation, characterization, and continuity of multivariate monotonic regression functions

Variable metric inexact line-search based methods for nonsmooth optimization

Outer approximation methods for solving variational inequalities in Hilbert space