Abstract:The spectral $p$-norm and nuclear $p$-norm of matrices and tensors appear in various applications albeit both are NP-hard to compute. The former sets a foundation of $\ell_p$-sphere constrained polynomial optimization problems and the latter has been found in many rank minimization problems in machine learning. We study approximation algorithms of the tensor nuclear $p$-norm with an aim to establish the approximation bound matching the best one of its dual norm, the tensor spectral $p$-norm. Driven by the application of sphere covering to approximate both tensor spectral and nuclear norms ($p=2$), we propose several types of hitting sets that approximately represent $\ell_p$-sphere with adjustable parameters for different levels of approximations and cardinalities, providing an independent toolbox for decision making on $\ell_p$-spheres. Using the idea in robust optimization and second-order cone programming, we obtain the first polynomial-time algorithm with an $\Omega(1)$-approximation bound for the computation of the matrix nuclear $p$-norm when $p\in(2,\infty)$ is a rational, paving a way for applications in modeling with the matrix nuclear $p$-norm. These two new results enable us to propose various polynomial-time approximation algorithms for the computation of the tensor nuclear $p$-norm using tensor partitions, convex optimization and duality theory, attaining the same approximation bound to the best one of the tensor spectral $p$-norm. We believe the ideas of $\ell_p$-sphere covering with its applications in approximating nuclear $p$-norm would be useful to tackle optimization problems on other sets such as the binary hypercube with its applications in graph theory and neural networks, the nonnegative sphere with its applications in copositive programming and nonnegative matrix factorization.

Optimal Error Bounds in the Absence of Constraint Qualifications with Applications to p-Cones and Beyond

Generalized Power Cones: Optimal Error Bounds and Automorphisms

Tight error bounds for log-determinant cones without constraint qualifications

Constraint Qualifications for Convex Inequality Systems with Applications in Constrained Optimization

Error Bounds for Approximate Solutions of Abstract Inequality Systems and Infinite Systems of Inequalities on Banach Spaces

Error Bounds for Abstract Linear Inequality Systems

Quantitative Analysis for Perturbed Abstract Inequality Systems in Banach Spaces

Constraint Qualification, the Strong CHIP, and Best Approximation with Convex Constraints in Banach Spaces.

On Best Approximation by Nonconvex Sets and Perturbation of Nonconvex Inequality Systems in Hilbert Spaces.

Approximate Solutions for Abstract Inequality Systems

On Error Bounds of Inequalities in Asplund Spaces

The Equivalence of Three Types of Error Bounds for Weakly and Approximately Convex Functions

Error Bounds for Some Convex Functions and Distance Composite Functions

Optimal error estimates for analytic continuation in the upper half-plane

Asymptotic theory of $C$-pseudo-cones

$\ell_p$-sphere covering and approximating nuclear $p$-norm

New Bounds for the Integer Carathéodory Rank

Optimal Control on Positive Cones

Extreme Point Pursuit -- Part II: Further Error Bound Analysis and Applications

Exploiting cone approximations in an augmented Lagrangian method for conic optimization

Optimal Polynomial Approximants in $H^p$