Abstract:As a convex relaxation of the rank minimization model, the nuclear norm minimization (NNM) problem has been attracting significant research interest in recent years. The standard NNM regularizes each singular value equally, composing an easily calculated convex norm. However, this restricts its capability and flexibility in dealing with many practical problems, where the singular values have clear physical meanings and should be treated differently. In this paper we study the weighted nuclear norm minimization (WNNM) problem, which adaptively assigns weights on different singular values. As the key step of solving general WNNM models, the theoretical properties of the weighted nuclear norm proximal (WNNP) operator are investigated. Albeit nonconvex, we prove that WNNP is equivalent to a standard quadratic programming problem with linear constrains, which facilitates solving the original problem with off-the-shelf convex optimization solvers. In particular, when the weights are sorted in a non-descending order, its optimal solution can be easily obtained in closed-form. With WNNP, the solving strategies for multiple extensions of WNNM, including robust PCA and matrix completion, can be readily constructed under the alternating direction method of multipliers paradigm. Furthermore, inspired by the reweighted sparse coding scheme, we present an automatic weight setting method, which greatly facilitates the practical implementation of WNNM. The proposed WNNM methods achieve state-of-the-art performance in typical low level vision tasks, including image denoising, background subtraction and image inpainting.

A lagrange programming neural network approach for nuclear norm optimization

Neural Network Method for Solving Elastoplastic Finite Element Problems

Neural Network Solution for General Nonlinear Optimization Problems

Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization.

On the Optimal Solution of Weighted Nuclear Norm Minimization.

A discrete-time neural network for optimization problems with hybrid constraints.

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

A Novel Neural Network for Nonlinear Convex Programming

Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision

Projected Neural Network for a Class of Non-Lipschitz Optimization Problems with Linear Constraints.

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

Weighted Nuclear Norm Minimization with Application to Image Denoising.

Nonconvex Nonsmooth Low-Rank Minimization Via Iteratively Reweighted Nuclear Norm

Stochastic Proximal Gradient Descent for Nuclear Norm Regularization

SVD-free Convex-Concave Approaches for Nuclear Norm Regularization.

Combinatorial Optimization Neural Nets Based On A Hybrid Of Lagrange And Transformation Approaches

A Comparative Study for the Nuclear Norms Minimization Methods.

Nuclear Norm Regularization for Deep Learning

Two Recurrent Neural Networks With Reduced Model Complexity for Constrained l1-Norm Optimization

Neural Network for a Class of Sparse Optimization with L0-regularization.