Abstract:In this paper, we propose a neural network modeled by a differential inclusion to solve a class of discontinuous and nonconvex sparse regression problems with general convex constraints, whose objective function is the sum of a convex but not necessarily differentiable loss function and L 0 regularization. We construct a smoothing relaxation function of L 0 regularization and propose a neural network to solve the considered problem. We prove that the solution of proposed neural network with any initial point satisfying linear equality constraints is global existent, bounded and reaches the feasible region in finite time and remains there thereafter. Moreover, the solution of proposed neural network is its slow solution and any accumulation point of it is a Clarke stationary point of the brought forward nonconvex smoothing approximation problem. In the box-constrained case, all accumulation points of the solution own a unified lower bound property and have a common support set. Except for a special case, any accumulation point of the solution is a local minimizer of the considered problem. In particular, the proposed neural network has a simple structure than most existing neural networks for solving the locally Lipschitz continuous but nonsmooth nonconvex problems. Finally, we give some numerical experiments to show the efficiency of proposed neural network.

A Neural Network For Smooth Nonconvex Saddle Point Problems

Subgradient-based Neural Networks for Nonsmooth Nonconvex Optimization Problems

Solving A Class Of Saddle Point Problems By Neural Networks

Neural Network for Solving Constrained Convex Optimization Problems with Global Attractivity

Neural Network for Nonsmooth Pseudoconvex Optimization with General Convex Constraints

Neural Network for Nonsmooth, Nonconvex Constrained Minimization Via Smooth Approximation.

A neural network for constrained saddle point problems: an approximation approach

A Neural Network Model For General Minimax Problem

Smoothing Neural Network for Constrained Non-Lipschitz Optimization with Applications

Projected Neural Network for a Class of Non-Lipschitz Optimization Problems with Linear Constraints.

A neural network model for non-smooth optimization over a compact convex subset

Neural Network Solution for General Nonlinear Optimization Problems

A Neural Network for Solving Nonlinear Convex Programming with Linear Equality and Bounded Constraints

Smoothing Neural Network for L 0 Regularized Optimization Problem with General Convex Constraints

A Decentralized Proximal Point-type Method for Non-convex Non-concave Saddle Point Problems

A Two-Layer Recurrent Neural Network for Nonsmooth Convex Optimization Problems

Neural Network for Constrained Nonsmooth Optimization Using Tikhonov Regularization.

A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization.

A discrete-time neural network for optimization problems with hybrid constraints.

A Recurrent Neural Network for Solving Nonconvex Optimization Problems