Abstract:Sparse optimization involving the L0-norm function as the regularization in objective function has a wide application in many fields. In this paper, we propose a projected neural network modeled by a differential equation to solve a class of these optimization problems, in which the objective function is the sum of a nonsmooth convex loss function and the regularization defined by the L0-norm function. This optimization problem is not only nonconvex, but also discontinuous. To simplify the structure of the proposed network and let it own better convergence properties, we use the smoothing method, where the new constructed smoothing function for the regularization term plays a key role. We prove that the solution to the proposed network is globally existent and unique, and any accumulation point of it is a critical point of the continuous relaxation model. Except for a special case, which can be easily justified, any critical point is a local minimizer of the considered sparse optimization problem. It is an interesting thing that all critical points own a promising lower bound property, which is satisfied by all global minimizers of the considered problem, but is not by all local minimizers. Finally, we use some numerical experiments to illustrate the efficiency and good performance of the proposed method for solving this class of sparse optimization problems, which include the most widely used models in feature selection of classification learning.

A New Neural Network for L(1)-Norm Programming

A Simple Neural Network for Sparse Optimization with $l_1$ Regularization

A Neural Network Model For General Minimax Problem

Neural Network Solution for General Nonlinear Optimization Problems

A discrete-time neural network for optimization problems with hybrid constraints.

A Neural Network for Solving Nonlinear Convex Programming with Linear Equality and Bounded Constraints

Smoothing Neural Network for L 0 Regularized Optimization Problem with General Convex Constraints

Neural Network for a Class of Sparse Optimization with L0-regularization.

Two Recurrent Neural Networks With Reduced Model Complexity for Constrained l1-Norm Optimization

A New Neural Network Model And Its Application

A Neural Network Based on a Nonsmooth Equation for a Box Constrained Variational Inequality Problem

Design of Recurrent Neural Networks for Solving Constrained Least Absolute Deviation Problems.

A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization.

Projected Neural Network for a Class of Non-Lipschitz Optimization Problems with Linear Constraints.

A novel two-layer fuzzy neural network for solving inequality-constrained ℓ1-minimization problem with applications

A Novel Neural Network for Nonlinear Convex Programming

A one-layer recurrent neural network for nonsmooth pseudoconvex optimization with quasiconvex inequality and affine equality constraints

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems

A neural-based nonlinear L 1 -norm optimization algorithm for diagnosis of networks

Neural Network for Nonsmooth Pseudoconvex Optimization with General Convex Constraints