Convergence analysis of discrete time RNNs for linear variational inequality problem

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_6

2007-01-01

Abstract:null

What problem does this paper attempt to address?

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Tang, H.J.,Tan, K.C.,Zhang, Y.

DOI: https://doi.org/10.1109/IJCNN.2002.1007530

2002-01-01

Abstract:We study the convergence of a class of discrete recurrent neural networks to solve linear variational inequality problem (LVIP). LVIP has important applications in engineering and economics. Not only the network's exponential convergence for the case of positive definite matrix is proved, but its global convergence for positive semidefinite matrix is also proved. Conditions are derived to guarantee the convergences of the network. Comprehensive examples are discussed and simulated to illustrate the results
Output convergence analysis for delayed RNN with time varying inputs

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_16

2007-01-01

Abstract:null
Convergence Analysis of Projection Method for Variational Inequalities

Yekini Shehu,Olaniyi. S. Iyiola,Xiao-Huan Li,Qiao-Li Dong

DOI: https://doi.org/10.1007/s40314-019-0955-9

2021-01-22

Abstract:The main contributions of this paper are the proposition and the convergence analysis of a class of inertial projection-type algorithm for solving variational inequality problems in real Hilbert spaces where the underline operator is monotone and uniformly continuous. We carry out a unified analysis of the proposed method under very mild assumptions. In particular, weak convergence of the generated sequence is established and nonasymptotic $O(1/n)$ rate of convergence is established, where $n$ denotes the iteration counter. We also present some experimental results to illustrate the profits gained by introducing the inertial extrapolation steps.

Optimization and Control,Functional Analysis
Convergence Analysis of a Method for Variational Inclusions

M. H. Rashid,J. H. Wang,C. Li

DOI: https://doi.org/10.1080/00036811.2011.618127

2011-01-01

Applicable Analysis

Abstract:Consider the following variational inclusion problem: where f is differentiable in a neighbourhood of a solution and g is differentiable at , and F is a set-valued mapping, and the method introduced in Jean-Alexis and Pietrus [C. Jean-Alexis and A. Pietrus, On the convergence of some methods for variational inclusions, Rev. R. Acad. Cien. serie A. Mat. 102(2) (2008), pp. 355–361] for solving this problem: where ∇f(x) denotes the Fréchet derivative of f at x and [x, y; g] the first-order divided difference of g on the points x and y. Local converge analysis are provided for the method under the weaker conditions than Jean-Alexis and Pietrus (2008). Moreover, if ∇f and the first-order divided difference of g are p-Hölder continuous at a solution, then we show that this method converges superlinearly. In particular, our results extend the corresponding ones Jean-Alexis and Pietrus (2008), and fix a gap in the proof in (Jean-Alexis and Pietrus (2008), Theorem 1).
A discrete-time neural network for optimization problems with hybrid constraints.

Huajin Tang,Haizhou Li,Zhang Yi

DOI: https://doi.org/10.1109/TNN.2010.2049368

2010-01-01

Abstract:Recurrent neural networks have become a prominent tool for optimizations including linear or nonlinear variational inequalities and programming, due to its regular mathematical properties and well-defined parallel structure. This brief presents a general discrete-time recurrent network for linear variational inequalities and related optimization problems with hybrid constraints. In contrary to the existing discrete-time networks, this general model can operate not only on bound constraints, but also on hybrid constraints comprised of inequality, equality and bound constraints. The model has dynamical properties of global convergence, asymptotical and exponential convergences under some weaker conditions. Numerical examples demonstrate its efficacy and performance.
A fast algorithm for solving large scale nonlinear optimization problems using RNN

Xiaoliang Xu,Huajin Tang,Xiaoxin Shi

DOI: https://doi.org/10.1109/ICCIS.2008.4670798

2008-01-01

Abstract:This paper presents a discrete-time recurrent neural network (RNN) model for solving nonlinear differentiable constrained optimization problems, which contain the special case of convex optimizations over constrained sets and variational inequality problem. The qualitative analysis results about the regularity and completeness of the proposed network have been obtained. It is shown that all trajectories starting from any initial point in Rfrn converge to the equilibrium set of the recurrent system. This RNN model shows its great simplicity in contrast to other existing neural network solvers. Simulations for a class of large scale linear complementarity problems illustrate the fast convergence and features of the proposed RNN model.
Convergence Analysis For Non Linear System Of Parabolic Variational Inequalities

Yahya Alnashri

DOI: https://doi.org/10.48550/arXiv.2111.14264

2021-11-29

Abstract:This work aims to provide a comprehensive and unified numerical analysis for non linear system of parabolic variational inequalities (PVIs) subject to Dirichlet boundary condition. This analysis enables us to establish an existence of the exact solution to the considered model and to prove the convergence for the approximate solution and its approximate gradient. Our results are applicable for several conforming and non conforming numerical schemes.

Analysis of PDEs,Numerical Analysis
Convergence Analysis Of An Inertial Tseng'S Extragradient Algorithm For Solving Pseudomonotone Variational Inequalities And Applications

Liya Liu,Sun Young Cho,Jen-Chih Yao

DOI: https://doi.org/10.23952/jnva.5.2021.4.09

2021-01-01

Journal of Nonlinear and Variational Analysis

Abstract:The purpose of this paper is to investigate the convergence analysis of an inertial Tseng's extragradient algorithm for solving pseudomonotone variational inequalities. Weak convergence theorems are established in Hilbert spaces. Simulation experiments show that our proposed algorithm outperforms some previously known algorithms.
Convergence Analysis of General Decomposition Algorithm for Solving General Constrained Variational Inequality Problems

Qi-hui LU,Dao-li ZHU

DOI: https://doi.org/10.3969/j.issn.1001-9847.2006.02.004

2006-01-01

Abstract:In this paper, we generalize the augmented Lagrangian duality theory for the general varψ(x* ,y)-ψ(x* ,x*)≥0,()y∈Γ, whereΓ= {y∈ X| ()(y) ∈-C}. We proposeageneraldecomposition algorithm based on the augmented Lagrangian for solving this complex general variational inequality problems with the coupling constraints.
Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Jinhua Wang,Xiangmei Wang,Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1137/19m1289285

IF: 2.763

2021-01-01

SIAM Journal on Optimization

Abstract:We study the convergence issue for the gradient algorithm (employing general step sizes) for optimization problems on general Riemannian manifolds (without curvature constraints). Under the assumption of the local convexity/quasi-convexity (resp. weak sharp minima), local/global convergence (resp. linear convergence) results are established. As an application, the linear convergence properties of the gradient algorithm employing the constant step sizes and the Armijo step sizes for finding the Riemannian $L^p$ ($p\in[1,+\infty)$) centers of mass are explored, respectively, which in particular extend and/or improve the corresponding results in \cite{Afsari2013}.
Convergence of an Iterative Algorithm for Systems of Variational Inequalities and Nonexpansive Mappings with Applications

Xiaolong Qin,Sun Young Cho,Shin Min Kang

DOI: https://doi.org/10.1016/j.cam.2009.07.018

IF: 2.872

2009-01-01

Journal of Computational and Applied Mathematics

Abstract:In this paper, we consider the problem of convergence of an iterative algorithm for a system of generalized variational inequalities and a nonexpansive mapping. Strong convergence theorems are established in the framework of real Banach spaces.
Variational Inequalities for Set-Valued Vector Fields on Riemannian Manifolds: Convexity of the Solution Set and the Proximal Point Algorithm.

Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1137/110834962

IF: 2.2

2012-01-01

SIAM Journal on Control and Optimization

Abstract:We consider variational inequality problems for set-valued vector fields on general Riemannian manifolds. The existence results of the solution, convexity of the solution set, and the convergence property of the proximal point algorithm for the variational inequality problems for set-valued mappings on Riemannian manifolds are established. Applications to convex optimization problems on Riemannian manifolds are provided.
Discrete-Time Projection Neural Network Methods for Computing the Solution of Variational Inequalities

Liping Zhang,Shu-Lin Wu

DOI: https://doi.org/10.22436/jnsa.010.04.49

2017-01-01

Abstract:Neural networks are useful tools to solve mathematical and engineering problems. By using the implicit-explicit-theta method and the method proposed recently by Mohamad to discretize the continuous-time neural networks, we formulate two classes of discrete-time analogues to solve a system of variational inequalities. By adopting suitable Lyapunov functions and Razumikhin-type techniques, exponential stability of the discrete neural networks are established in terms of linear matrix inequalities (LMIs). Several numerical experiments are performed to compare the convergence rates of the proposed discrete neural networks and it is shown that:(a) all of the discrete neural networks converge faster as the step size becomes larger;(b) the discrete neural networks derived by the semi-implicit Euler method performs best. (C) 2017 All rights reserved.
Solving variational inequalities and related problems using recurrent neural networks

Jun Wang,Xiaolin Hu

2007-01-01

Abstract:Variational inequality (VI) can be viewed as a natural framework for unifying the treatment of equilibrium problems, and hence has applications across many disciplines. In addition, many typical problems are closely related to VI, including general VI (GVI), complementarity problem (CP), generalized CP (GCP) and optimization problem (OP). During the past two decades, numerous recurrent neural networks (RNNs) have been proposed for solving VIs and related problems. However, first, the theories of many emerging RNNs have not been well founded yet; and their capabilities have been underestimated. Second, these RNNs have limitations in handling some types of problems. Third, it is certainly not true that these RNNs are best choices for solving all problems, and new network models with more favorable characteristics could be devised for solving specific problems. In the research, the above issues are extensively explored from dynamic system perspective, which leads to the following major contributions. On one hand, many new capabilities of some existing RNNs have been revealed for solving VIs and related problems. On the other hand, several new RNNs have been invented for solving some types of these problems. The contributions are established on the following facts. First, two existing RNNs, called TLPNN and PNN, are found to be capable of solving pseudomonotone VIs and related problems with simple bound constraints. Second, many more stability results are revealed for an existing RNN, called GPNN, for solving GVIs with simple bound constraints, and it is then extended to solve linear VIs (LVIs) and generalized linear VIs (GLVIs) with polyhedron constraints. Third, a new RNN, called IDNN, is proposed for solving a special class of quadratic programming problems which features lower structural complexity compared with existing RNNs. Fourth, some local convergence results of an existing RNN, called EPNN, for nonconvex optimization are obtained, and two variants of the network by incorporating two augmented Lagrangian function techniques are proposed for seeking Karush-Kuhn-Tucker (KKT) points, especially local optima, of the problems.
Existence of Solutions for Variational Inequalities on Riemannian Manifolds

Shu-Long Li,Chong Li,Yeong-Cheng Liou,Jen-Chih Yao

DOI: https://doi.org/10.1016/j.na.2009.04.048

IF: 1.743

2009-01-01

Nonlinear Analysis

Abstract:We establish the existence and uniqueness results for variational inequality problems on Riemannian manifolds and solve completely the open problem proposed in [S.Z. Németh, Variational inequalities on Hadamard manifolds, Nonlinear Anal. 52 (2003) 1491–1498]. Also the relationships between the constrained optimization problem and the variational inequality problems as well as the projections on Riemannian manifolds are studied.
Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Jinhua Wang,Chong Li,Genaro Lopez,Jen-Chih Yao

DOI: https://doi.org/10.1007/s10898-014-0182-2

2014-01-01

Journal of Global Optimization

Abstract:Inexact proximal point methods are extended to find singular points for multivalued vector fields on Hadamard manifolds. Convergence criteria are established under some mild conditions. In particular, in the case of proximal point algorithm, that is, ε _n=0 for each n , our results improve sharply the corresponding results in Li et al. ( 2009 ). Applications to optimization problems, variational inequality problems and gradient methods are also given.
STRONG CONVERGENCE THEOREM FOR SOME SOLUTION OF NONLINEAR VARIATIONAL INEQUALITY

TAN Hua-jun,HE Zhong-quan

DOI: https://doi.org/10.3969/j.issn.1674-8085.2011.03.001

2011-01-01

Abstract:We study the convergence of the solution of some nonlinear variational inequality in Hilbert space. A strong convergence theorem is proved based on a proposed iterative algorithm,which extends and improves the corresponding results.
A New Decomposition Method for Variational Inequalities with Linear Constraints

Min Zhang,Deren Han,Gang Qian,Xihong Yan

DOI: https://doi.org/10.1007/s10957-011-9931-2

2011-01-01

Journal of Optimization Theory and Applications

Abstract:We propose a new decomposition method for solving a class of monotone variational inequalities with linear constraints. The proposed method needs only to solve a well-conditioned system of nonlinear equations, which is much easier than a variational inequality, the subproblem in the classic alternating direction methods. To make the method more flexible and practical, we solve the sub-problems approximately. We adopt a self-adaptive rule to adjust the parameter, which can improve the numerical performance of the algorithm. Under mild conditions, the underlying mapping be monotone and the solution set of the problem be nonempty, we prove the global convergence of the proposed algorithm. Finally, we report some preliminary computational results, which demonstrate the promising performance of the new algorithm.
Convergence Analysis of Non-Strongly-Monotone Stochastic Quasi-Variational Inequalities

Zeinab Alizadeh,Afrooz Jalilzadeh

2024-10-30

Abstract:While Variational Inequality (VI) is a well-established mathematical framework that subsumes Nash equilibrium and saddle-point problems, less is known about its extension, Quasi-Variational Inequalities (QVI). QVI allows for cases where the constraint set changes as the decision variable varies allowing for a more versatile setting. In this paper, we propose extra-gradient and gradient-based methods for solving a class of monotone Stochastic Quasi-Variational Inequalities (SQVI) and establish a rigorous convergence rate analysis for these methods. Our approach not only advances the theoretical understanding of SQVI but also demonstrates its practical applicability. Specifically, we highlight its effectiveness in reformulating and solving problems such as generalized Nash Equilibrium, bilevel optimization, and saddle-point problems with coupling constraints.

Optimization and Control
Convergence Analysis of Asymptotical Regularization and Runge-Kutta Integrators for Linear Inverse Problems under Variational Source Conditions

Yubin Zhao,Peter Mathe,Shuai Lu

DOI: https://doi.org/10.4208/csiam-am.2020-0022

2020-01-01

CSIAM Transactions on Applied Mathematics

Abstract:Variational source conditions are known to be a versatile tool for establishing error bounds, and these recently attract much attention. We establish sufficient conditions for general spectral regularization methods which yield convergence rates under variational source conditions. Specifically, we revisit the asymptotical regularization, Runge-Kutta integrators, and verify that these methods satisfy the proposed conditions. Numerical examples confirm the theoretical findings.

Convergence analysis of discrete time RNNs for linear variational inequality problem

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Output convergence analysis for delayed RNN with time varying inputs

Convergence Analysis of Projection Method for Variational Inequalities

Convergence Analysis of a Method for Variational Inclusions

A discrete-time neural network for optimization problems with hybrid constraints.

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Convergence Analysis For Non Linear System Of Parabolic Variational Inequalities

Convergence Analysis Of An Inertial Tseng'S Extragradient Algorithm For Solving Pseudomonotone Variational Inequalities And Applications

Convergence Analysis of General Decomposition Algorithm for Solving General Constrained Variational Inequality Problems

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Convergence of an Iterative Algorithm for Systems of Variational Inequalities and Nonexpansive Mappings with Applications

Variational Inequalities for Set-Valued Vector Fields on Riemannian Manifolds: Convexity of the Solution Set and the Proximal Point Algorithm.

Discrete-Time Projection Neural Network Methods for Computing the Solution of Variational Inequalities

Solving variational inequalities and related problems using recurrent neural networks

Existence of Solutions for Variational Inequalities on Riemannian Manifolds

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

STRONG CONVERGENCE THEOREM FOR SOME SOLUTION OF NONLINEAR VARIATIONAL INEQUALITY

A New Decomposition Method for Variational Inequalities with Linear Constraints

Convergence Analysis of Non-Strongly-Monotone Stochastic Quasi-Variational Inequalities

Convergence Analysis of Asymptotical Regularization and Runge-Kutta Integrators for Linear Inverse Problems under Variational Source Conditions