Abstract:Learning methods in Banach spaces are often formulated as regularization problems which minimize the sum of a data fidelity term in a Banach norm and a regularization term in another Banach norm. Due to the infinite dimensional nature of the space, solving such regularization problems is challenging. We construct a direct sum space based on the Banach spaces for the data fidelity term and the regularization term, and then recast the objective function as the norm of a suitable quotient space of the direct sum space. In this way, we express the original regularized problem as an unregularized problem on the direct sum space, which is in turn reformulated as a dual optimization problem in the dual space of the direct sum space. The dual problem is to find the maximum of a linear function on a convex polytope, which may be solved by linear programming. A solution of the original problem is then obtained by using related extremal properties of norming functionals from a solution of the dual problem. Numerical experiments are included to demonstrate that the proposed duality approach leads to an implementable numerical method for solving the regularization learning problems.

A MODEL FUNCTION METHOD IN TOTAL LEAST SQUARES

A Model Function Method In Regularized Total Least Squares

Regularized Total Least Squares: Computational Aspects and Error Bounds.

Dual Regularized Total Least Squares and Multi-Parameter Regularization

Regularization Total Least Squares and Randomized Algorithms

An alternating iterative minimisation algorithm for the double-regularised total least square functional

Multi-parameter Regularization and Its Numerical Realization

Tikhonov Regularization for Weighted Total Least Squares Problems

Regularized and Structured Tensor Total Least Squares Methods with Applications

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

A Duality Approach to Regularized Learning Problems in Banach Spaces

Recursive Total Least-Squares Algorithm Based on Inverse Power Method and Dichotomous Coordinate-Descent Iterations

A Gauss–Newton method for mixed least squares-total least squares problems

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

Discrepancy Curves for Multi-Parameter Regularization

Tensor Regularized Total Least Squares Methods with Applications to Image and Video Deblurring

Model Functions in the Modified L-Curve Method-Case Study: the Heat Flux Reconstruction in Pool Boiling

Randomized algorithms for total least squares problems.

General Nonconvex Total Variation and Low-Rank Regularizations: Model, Algorithm and Applications

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems