Abstract:In this work we solve, for given bounded operators $B,C$ and Hilbert--Schmidt operator $M$ acting on potentially infinite-dimensional separable Hilbert spaces, the reduced rank approximation problem, $\text{min}\{\Vert{M-BXC}\Vert_{HS}:\ \text{dim}\ \text{ran}(X)\leq r\}$. This extends the result of Sondermann (Statistische Hefte, 1986) and Friedland and Torokhti (SIAM J. Matrix Analysis and Applications, 2007), which studies this problem in the case of matrices $M$, $B$, $C$, $X$, and the analysis involves the Moore-Penrose inverse. In classical approximation problems that can be solved by the singular value decomposition or Moore--Penrose inverse, the solution satisfies a minimal norm property. Friedland and Torokhti also state such a minimal norm property of the solution. However, we show that this minimal norm property does not hold in general and give a modified minimality property that is satisfied in general. We also show that the solution may be discontinuous in infinite-dimensional settings. Necessary and sufficient conditions for continuity of the solutions are given and continuous approximations are constructed when such conditions are not met. Finally, we study problems from signal processing, reduced rank regression and linear operator learning under a rank constraint. We show that our theoretical results enable us to explicitly find the solutions to these problems and to fully characterise their existence, uniqueness and minimality property.

Global solutions of approximation problems in Krein spaces

GLOBAL EXISTENCE OF SOLUTIONS FOR QUADRATIC QUASI-LINEAR KLEIN-GORDON SYSTEMS IN ONE SPACE DIMENSION

Discrete Approximation of Optimal Transport on Compact Spaces

Generalised rank-constrained approximations of Hilbert-Schmidt operators on separable Hilbert spaces and applications

Approximation of optimization problems with constraints through kernel Sum-Of-Squares

Global Implicit Function Theorems and Critical Point Theory in Fréchet Spaces

-metric function in the problem of minimization of functionals

Local Conditions for Global Convergence of Gradient Flows and Proximal Point Sequences in Metric Spaces

Approximation of Solutions of A Generalized Variational Inequality Problem Based on Iterative Methods

Multi- and Infinite-variate Integration and $L^2$-Approximation on Hilbert Spaces with Gaussian Kernels

ON GLOBAL SMOOTH SMALL DATA SOLUTIONS OF 3-D QUASILINEAR KLEIN-GORDON EQUATIONS ON R2 x T

A hybrid Krasnosel'skiĭ-Schauder fixed point theorem for systems

Open problems and perspectives on solving Friedrichs systems by Krylov approximation

Weighted Least Approximation on Compact Riemannian Manifolds

Positive Definite Kernels, Algorithms, Frames, and Approximations

Error Bounds for a Kernel-Based Constrained Optimal Smoothing Approximation

Algorithms of constrained uniform approximation

Approximation Solvability of Two Nonlinear Optimization Problems Involving Monotone Operators

APPROXIMATION OF COMMON SOLUTIONS OF VARIATIONAL INEQUALITIES VIA STRICT PSEUDOCONTRACTIONS

Inexact Global FOM and GMRES Methods for Solving Linear Systems with Multiple Right-Hand Sides