A New Derivative-free Descent Method for Nonlinear Complementarity Problems

Lihua Jiang,Lihua Liu

2006-01-01

Abstract:A new globally convergent derivative-free descent method for solving nonlinear complementarity problems is proposed based on its equivalent formulation of minimization.The reasonable and global convergence of the method is verified.

What problem does this paper attempt to address?

An R-linearly Convergent Nonmonotone Derivative-Free Method for Symmetric Cone Complementarity Problems

Shaohua Pan,Jein-Shan Chen

2011-01-01

Abstract:This paper extends the derivative-free descent method (18) for the nonlinear complementarity problem to the symmetric cone complementarity problem (SCCP). The algorithm is based on the unconstrained implicit Lagrangian reformulation of the SCCP, but uses a convex combination of the negative partial gradients of the implicit Lagrangian function ψα, i.e. the vector of the form −θ∇xψα −(1 −θ)∇yψα for θ ∈ (0, 1), as the search direction, and a nonmonotone line search rule to seek a desirable stepsize. We show that the derivative-free algorithm converges in terms of the implicit Lagrangian value for a large class of SCCPs that may even not be monotone. If θ is restricted to be less than a threshold ¯ θ ∈ (0, 1) and the SCCP is strongly monotone, the sequence generated converges globally to the solution of SCCP at a R-linear rate.
A Linearly Convergent Derivative-Free Descent Method for the Second-Order Cone Complementarity Problem

Shaohua Pan,Jein-Shan Chen

DOI: https://doi.org/10.1080/02331930903085359

IF: 2.2

2010-01-01

Optimization

Abstract:We consider a class of derivative-free descent methods for solving the second-order cone complementarity problem (SOCCP). The algorithm is based on the Fischer–Burmeister (FB) unconstrained minimization reformulation of the SOCCP, and utilizes a convex combination of the negative partial gradients of the FB merit function ψFB as the search direction. We establish the global convergence results of the algorithm under monotonicity and the uniform Jordan P-property, and show that under strong monotonicity the merit function value sequence generated converges at a linear rate to zero. Particularly, the rate of convergence is dependent on the structure of second-order cones. Numerical comparisons are also made with the limited BFGS method used by Chen and Tseng (An unconstrained smooth minimization reformulation of the second-order cone complementarity problem, Math. Program. 104(2005), pp. 293–327), which confirm the theoretical results and the effectiveness of the algorithm.
An R-linearly Convergent Derivative-Free Algorithm for Nonlinear Complementarity Problems Based on the Generalized Fischer-Burmeister Merit Function

Jein-Shan Chen,Hung-Ta Gao,Shaohua Pan

DOI: https://doi.org/10.1016/j.cam.2009.06.022

IF: 2.872

2009-01-01

Journal of Computational and Applied Mathematics

Abstract:In the paper [J.-S. Chen, S. Pan, A family of NCP-functions and a descent method for the nonlinear complementarity problem, Computational Optimization and Applications, 40 (2008) 389–404], the authors proposed a derivative-free descent algorithm for nonlinear complementarity problems (NCPs) by the generalized Fischer–Burmeister merit function: ψp(a,b)=12[‖(a,b)‖p−(a+b)]2, and observed that the choice of the parameter p has a great influence on the numerical performance of the algorithm. In this paper, we analyze the phenomenon theoretically for a derivative-free descent algorithm which is based on a penalized form of ψp and uses a different direction from that of Chen and Pan. More specifically, we show that the algorithm proposed is globally convergent and has a locally R-linear convergence rate, and furthermore, its convergence rate will become worse when the parameter p decreases. Numerical results are also reported for the test problems from MCPLIB, which further verify the theoretical results obtained.
A New Descent Nonlinear Conjugate Gradient Method for Unconstrained Optimization

Hao Fan,Zhibin Zhu,Anwa Zhou

DOI: https://doi.org/10.4236/am.2011.29154

2011-01-01

Applied Mathematics

Abstract:In this paper, a new nonlinear conjugate gradient method is proposed for large-scale unconstrained optimization. The sufficient descent property holds without any line searches. We use some steplength technique which ensures the Zoutendijk condition to be held, this method is proved to be globally convergent. Finally, we improve it, and do further analysis.
A Feasible Decomposition Method for Constrained Equations and Its Application to Complementarity Problems

Xiang-li Li,Hong-wei Liu,Chang-he Liu

DOI: https://doi.org/10.1007/s10255-011-0090-x

2011-01-01

Abstract:In this paper, by analyzing the propositions of solution of the convex quadratic programming with nonnegative constraints, we propose a feasible decomposition method for constrained equations. Under mild conditions, the global convergence can be obtained. The method is applied to the complementary problems. Numerical results are also given to show the efficiency of the proposed method.
Global convergence of a conjugate descent algorithm

Shou-qiang DU,Yan GAO

DOI: https://doi.org/10.3969/j.issn.1007-6735.2008.04.007

2008-01-01

Abstract:A conjugate descent method for unconstrained optimization was proposed. The method is of the sufficient descent property. Under an inexact line search condition and some other mild conditions, the global convergence was established. Preliminary numerical results show that the proposed method is promising.
A Differential Equation Approach to Solving Nonlinear Complementarity Problems

Limei Zhou,Liwei Zhang,Suxiang He

DOI: https://doi.org/10.3969/j.issn.1007-6093.2005.03.002

2005-01-01

Abstract:In this paper, a differential equation approach is constructed to solve nonlinear complementarity problems. It is proved that equilibrium solutions of this differential system are solutions to the complementarity problem and a numerical algorithm is given based on the numerical integration of the system of ordinary differential equations. The convergence theorem is established for the numerical algorithm applied to the problem satisfying some assumptions. Some numerical results are reported to illustrate the efficiency of the differential equation approach.
Convergence of the Descent Nonlinear Conjugate Gradient Methods

李世顺,黄正达

DOI: https://doi.org/10.3785/j.issn.1008-9497.2009.04.007

2009-01-01

Abstract:Conjugate gradient methods are typically used to solve large scale unconstrained optimization problems. Two descent conjugate gradient methods are proposed,and the global convergence with standard Wolfe conditions is proved. The numerical results show that the methods are efficient for the given test problems.
A modified descent nonlinear conjugate gradient method

Xiaorang Zhang,Zhibin Zhu,Mingyan Xing

DOI: https://doi.org/10.3969/j.issn.1673-808X.2015.05.017

2015-01-01

Abstract:To solve unconstrained optimization problem,based on DY method and MMHS method,a modified descent conju-gate gradient method is presented.When Armijo line searching is used,the method is globally convergent.Numerical ex-periments show that the proposed method is effective and feasible.
Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

Jian Chen,Liping Tang,Xinmin Yang

2024-07-18

Abstract:In this paper, we develop a unified framework and convergence analysis of descent methods for vector optimization problems (VOPs) from a majorization-minimization perspective. By choosing different surrogate functions, the generic method reduces to some existing descent methods with and without line search, respectively. The unified convergence analysis shows that the slow convergence of the steepest descent method is mainly due to the large gap between surrogate and objective functions. As a result, the performance of descent methods can be improved by narrowing the surrogate gap. Interestingly, we observe that selecting a tighter surrogate function is equivalent to using an appropriate base of the dual cone in the direction-finding subproblem. Furthermore, we use Barzilai-Borwein method to narrow the surrogate gap and devise a Barzilai-Borwein descent method for VOPs with polyhedral cone. By reformulating the subproblem, we provide a new insight into the Barzilai-Borwein descent method and bridge it to the steepest descent method. Finally, several numerical experiments confirm the efficiency of the proposed method.

Optimization and Control
An Implicit Smooth Conjugate Projection Gradient Algorithm for Optimization with Nonlinear Complementarity Constraints

Cong Zhang,Limin Sun,Zhibin Zhu,Minglei Fang

DOI: https://doi.org/10.4236/am.2015.610152

2015-01-01

Applied Mathematics

Abstract:This paper discusses a special class of mathematical programs with equilibrium constraints. At first, by using a generalized complementarity function, the discussed problem is transformed into a family of general nonlinear optimization problems containing additional variable μ. Furthermore, combining the idea of penalty function, an auxiliary problem with inequality constraints is presented. And then, by providing explicit searching direction, we establish a new conjugate projection gradient method for optimization with nonlinear complementarity constraints. Under some suitable conditions, the proposed method is proved to possess global and superlinear convergence rate.
A Smoothing Approximation Algorithm for Nonlinear Complementarity Problems

Lihua Jiang

2012-01-01

Abstract:In order to solve nonlinear complementarity problems,we constructed a smoothing approximation function.Then we found a smoothing approximation algorithm for nonlinear complementarity problems based on its equivalent nonsmooth equations.Under suitable conditions,we got the global convergence of the algorithm.
A filter method for solving nonlinear complementarity problems based on derivative-free line search

Jun Long,Changfeng Ma

DOI: https://doi.org/10.1016/j.amc.2007.01.025

IF: 4.397

2007-01-01

Applied Mathematics and Computation

Abstract:In this work, we first translate the nonlinear complementarity problem (denoted by NCP(F)) into Newton equation with disturbance. When Jacobian of the NCP function is not invertible, we use the Broyden-like formulae to update it. Taking advantage of the virtue of filter technique, we propose a filter method for the nonlinear complementarity problem with derivative-free line search. The proposed algorithm is proved to be globally convergent under mild assumptions. Furthermore, we get superlinear convergence of the method under the proper conditions.
Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

Xiubin Xu,Chong Li

2007-01-01

Journal of Computational Mathematics

Abstract:The convergence properties of Newton's method for systems of equations with constant rank derivatives are studied under the hypothesis that the derivatives satisfy some weak Lipschitz conditions. The unified convergence results, which include Kantorovich type theorems and Smale's point estimate theorems as special cases, are obtained.
A Truly Globally Convergent Feasible Newton-Type Method for Mixed Complementarity Problems

D Han

2004-01-01

Journal of Computational Mathematics

Abstract:Typical solution methods for solving mixed complementarity problems either generate feasible iterates but have to solve relatively complicated subproblems such as quadratic programs or linear complementarity problems, or (those methods) have relatively simple subproblems such as system of linear equations but possibly generate infeasible iterates. In this paper, we propose a new Newton-type method for solving monotone mixed complementarity problems, which ensures to generate feasible iterates, and only has to solve a system of well-conditioned linear equations with reduced dimension per iteration. Without any regularity assumption, we prove that the whole sequence of iterates converges to a solution of the problem (truly globally convergent). Furthermore, under suitable conditions, the local superlinear rate of convergence is also established.
Decentralized Gradient Descent Maximization Method for Composite Nonconvex Strongly-Concave Minimax Problems

Yangyang Xu

DOI: https://doi.org/10.1137/23m1558677

IF: 2.763

2024-03-13

SIAM Journal on Optimization

Abstract:SIAM Journal on Optimization, Volume 34, Issue 1, Page 1006-1044, March 2024. Minimax problems have recently attracted a lot of research interests. A few efforts have been made to solve decentralized nonconvex strongly-concave (NCSC) minimax-structured optimization; however, all of them focus on smooth problems with at most a constraint on the maximization variable. In this paper, we make the first attempt on solving composite NCSC minimax problems that can have convex nonsmooth terms on both minimization and maximization variables. Our algorithm is designed based on a novel reformulation of the decentralized minimax problem that introduces a multiplier to absorb the dual consensus constraint. The removal of dual consensus constraint enables the most aggressive (i.e., local maximization instead of a gradient ascent step) dual update that leads to the benefit of taking a larger primal stepsize and better complexity results. In addition, the decoupling of the nonsmoothness and consensus on the dual variable eases the analysis of a decentralized algorithm; thus our reformulation creates a new way for interested researchers to design new (and possibly more efficient) decentralized methods on solving NCSC minimax problems. We show a global convergence result of the proposed algorithm and an iteration complexity result to produce a (near) stationary point of the reformulation. Moreover, a relation is established between the (near) stationarities of the reformulation and the original formulation. With this relation, we show that when the dual regularizer is smooth, our algorithm can have lower complexity results (with reduced dependence on a condition number) than existing ones to produce a near-stationary point of the original formulation. Numerical experiments are conducted on a distributionally robust logistic regression to demonstrate the performance of the proposed algorithm.

mathematics, applied
A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

Zhifeng Dai,Xiaohong Chen,Fenghua Wen

DOI: https://doi.org/10.1016/j.amc.2015.08.014

IF: 4.397

2015-01-01

Applied Mathematics and Computation

Abstract:In this paper, we propose a derivative-free method for solving large-scale nonlinear monotone equations. It combines the modified Perry’s conjugate gradient method (I.E. Livieris, P. Pintelas, Globally convergent modified Perrys conjugate gradient method, Appl. Math. Comput., 218 (2012) 9197–9207) for unconstrained optimization problems and the hyperplane projection method (M.V. Solodov, B.F. Svaiter, A globally convergent inexact Newton method for systems of monotone equations, in: M. Fukushima, L. Qi (Eds.), Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, Kluwer Academic Publishers, 1998, pp. 355–369). We prove that the proposed method converges globally if the equations are monotone and Lipschitz continuous without differentiability requirement on the equations, which makes it possible to solve some nonsmooth equations. Another good property of the proposed method is that it is suitable to solve large-scale nonlinear monotone equations due to its lower storage requirement. Preliminary numerical results show that the proposed method is promising.
A Family of NCP Functions and a Descent Method for the Nonlinear Complementarity Problem

Jein-Shan Chen,Shaohua Pan

DOI: https://doi.org/10.1007/s10589-007-9086-0

2007-01-01

Computational Optimization and Applications

Abstract:In last decades, there has been much effort on the solution and the analysis of the nonlinear complementarity problem (NCP) by reformulating NCP as an unconstrained minimization involving an NCP function. In this paper, we propose a family of new NCP functions, which include the Fischer-Burmeister function as a special case, based on a p-norm with p being any fixed real number in the interval (1,+∞), and show several favorable properties of the proposed functions. In addition, we also propose a descent algorithm that is indeed derivative-free for solving the unconstrained minimization based on the merit functions from the proposed NCP functions. Numerical results for the test problems from MCPLIB indicate that the descent algorithm has better performance when the parameter p decreases in (1,+∞). This implies that the merit functions associated with p∈(1,2), for example p=1.5, are more effective in numerical computations than the Fischer-Burmeister merit function, which exactly corresponds to p=2.
A Modified Cg-Descent Method For Unconstrained Optimization

Zhifeng Dai,Fenghua Wen

DOI: https://doi.org/10.1016/j.cam.2011.01.046

IF: 2.872

2011-01-01

Journal of Computational and Applied Mathematics

Abstract:Recently, Hager and Zhang (2005) [11] proposed a new conjugate gradient method which generates sufficient descent direction g(k)(T)d(k) <= -7/8 parallel to g(k)parallel to(2), this property is independent of the line search used. In this paper, we take a modification of this method, such that the sufficient descent direction satisfies g(k)(T)d(k) = -parallel to gk parallel to(2), this property is also independent of the line search used. Under appropriate conditions, we prove that the proposed method is globally convergent. Moreover, we give a sufficient condition for the global convergence of the proposed general method. The numerical results show that the proposed method is efficient. (C) 2011 Elsevier B.V. All rights reserved.
An approximate proximal point algorithm for nonlinear complementarity problems

Abdellah Bnouhachem,Muhammad Aslam Noor,Mohamed Khalfaoui,Sheng Zhaohan

2012-01-01

Hacettepe Journal of Mathematics and Statistics

Abstract:In this paper, we suggest and analyze a new method for solving nonlinear complementarity problems (NCP) where the underlying function F is co-coercive. The theme of this paper is twofold. First, we consider the logarithmic-quadratic proximal (LQP) method which was introduced by Auslender, Teboulle and Ben-Tiba (A logarithmic-quadratic proximal method for variational inequalities, Comput. Optim. Appl. 12, 31-40, 1999). Next, we propose a new modified LQP method by using a new direction with a new step size alpha(k). We show that the method is globally convergent. Some preliminary computational results are given to illustrate the efficiency of the proposed method.

A New Derivative-free Descent Method for Nonlinear Complementarity Problems

An R-linearly Convergent Nonmonotone Derivative-Free Method for Symmetric Cone Complementarity Problems

A Linearly Convergent Derivative-Free Descent Method for the Second-Order Cone Complementarity Problem

An R-linearly Convergent Derivative-Free Algorithm for Nonlinear Complementarity Problems Based on the Generalized Fischer-Burmeister Merit Function

A New Descent Nonlinear Conjugate Gradient Method for Unconstrained Optimization

A Feasible Decomposition Method for Constrained Equations and Its Application to Complementarity Problems

Global convergence of a conjugate descent algorithm

A Differential Equation Approach to Solving Nonlinear Complementarity Problems

Convergence of the Descent Nonlinear Conjugate Gradient Methods

A modified descent nonlinear conjugate gradient method

Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

An Implicit Smooth Conjugate Projection Gradient Algorithm for Optimization with Nonlinear Complementarity Constraints

A Smoothing Approximation Algorithm for Nonlinear Complementarity Problems

A filter method for solving nonlinear complementarity problems based on derivative-free line search

Convergence of Newton'S Method for Systems of Equations with Constant Rank Derivatives

A Truly Globally Convergent Feasible Newton-Type Method for Mixed Complementarity Problems

Decentralized Gradient Descent Maximization Method for Composite Nonconvex Strongly-Concave Minimax Problems

A Modified Perry's Conjugate Gradient Method-Based Derivative-Free Method for Solving Large-Scale Nonlinear Monotone Equations

A Family of NCP Functions and a Descent Method for the Nonlinear Complementarity Problem

A Modified Cg-Descent Method For Unconstrained Optimization

An approximate proximal point algorithm for nonlinear complementarity problems