A Feasible and Superlinear Algorithm for Inequality Constrained Minimization Problems

Xu Yifan,Wang Wei

DOI: https://doi.org/10.1007/bf02670962

2000-01-01

Acta Mathematicae Applicatae Sinica

Abstract:In this paper, a new algorithm for inequality constrained optimization problems is presented. The algorithm is feasible and is globally and superlinearly convergent under some weaker assumptions—without strict complementary condition.

What problem does this paper attempt to address?

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Yu Chen,Xie Xiaoliang

2010-01-01

Journal of applied mathematics & informatics

Abstract:In this paper, A FSQP algorithm for degenerate inequality constraints optimization problems is proposed. At each iteration of the proposed algorithm, a feasible direction of descent is obtained by solving a quadratic programming subproblem. To overcome the Maratos effect, a higher-order correction direction is obtained by solving another quadratic programming subproblem. The algorithm is proved to be globally convergent and superlinearly convergent under some mild conditions. Finally, some preliminary numerical results are reported.
A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

Yongyou Hu,Hongye Su,Jian Chu

DOI: https://doi.org/10.1109/ICSMC.2004.1401357

2004-01-01

Abstract:In this paper, we present a new algorithm for unconstrained optimization problem with the form of sum of squares minimization that is produced in the procedure of model parameter estimation for nonlinear systems. The new algorithm is composed of conventional BFGS and analytical exact line search where the line search step is calculated by an analytical equation in which the second derivative matrix- called Hessian matrix is approximated by the product of Jacobin matrices of objective function. Two cases study shows that the new algorithm exhibits excellent convergence performance in terms of computation time and initial values requirement.
A QP-FREE AND SUPERLINEARLY CONVERGENT ALGORITHM FOR INEQUALITY CONSTRAINEDOPTIMIZATIONS

YF Xu,W Wang

DOI: https://doi.org/10.1016/s0252-9602(17)30585-4

2001-01-01

Acta Mathematica Scientia

Abstract:In this paper, a new mixed quasi-Newton method for inequality constrained optimization problems is proposed. The feature of the method is that only the systems of linear equations are solved in each iteration, other than the quadratic programming, which decrease the amount of computations and is also efficient for large scale problem. Under some mild assumptions without the strict complementary condition, the method is globally and superlinearly convergent.
A Mixed and Superlinearly Convergent Algorithm for Constrained Optimization.

YF Xu

DOI: https://doi.org/10.1080/10556780310001607965

2003-01-01

Abstract:In this paper, a mixed QP-free method for constrained optimization problem is proposed. This new method consists of two different sub-methods, sub-method I and sub-method II. These two sub-methods are all QP-free. A switch is designed to decide which sub-method should be adopted in each iteration. Under some mild assumptions, we prove that the method is globally and superlinearly convergent.
An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

Liwei Wang,Xinggao Liu,Zeyin Zhang

DOI: https://doi.org/10.1080/0305215x.2016.1176828

IF: 2.5

2016-01-01

Engineering Optimization

Abstract:An efficient primal-dual interior-point algorithm using a new non-monotone line esearch filter method is presented for nonlinear constrained programming, which is widely applied in engineering optimization. The new non-monotone line search technique is introduced to lead to relaxed step acceptance conditions and improved convergence performance. It can also avoid the choice of the upper bound on the memory, which brings obvious disadvantages to traditional techniques. Under mild assumptions, the global convergence of the new non-monotone line search filter method is analysed, and fast local convergence is ensured by second order corrections. The proposed algorithm is applied to the classical alkylation process optimization problem and the results illustrate its effectiveness. Some comprehensive comparisons to existing methods are also presented.
A New Method for Feasibility Analysis of Steady Constrained Optimization Systems

Dai Lian-kui

1998-01-01

Abstract:The feasibility analysis problem of steady constrained optimization systems is addressed in thispaper. A criteria for constrained optimization systems to be feasible is obtained,and an effective algorithm forfeasibility analysis is proposed. Using the algorithm,the feasible area of operation variables for complex industrial processes can be obtained.
A MIXED SUPERLINEARLY CONVERGENT ALGORITHM WITH NONMONOTONE SEARCH FOR CONSTRAINED OPTIMIZATIONS

Xu Yifan,Wang Wei

DOI: https://doi.org/10.1007/s11766-000-0028-1

2000-01-01

Abstract:In the paper, a new mixed algorithm combined with schemes of nonmonotone line search, the systems of linear equations for higher order modification and sequential quadratic programming for constrained optimizations is presented. Under some weaker assumptions,without strict complementary condition, the algorithm is globally and superlinearly convergent.
A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

Xinggao Liu,Yunqing Hu,Jianghua Feng,Kean Liu

DOI: https://doi.org/10.1109/tac.2014.2317293

IF: 6.549

2014-01-01

IEEE Transactions on Automatic Control

Abstract:The control vector parameterization (CVP) approach is popular to solve nonlinear dynamic optimization problems, but handling inequality path constraints within its framework is a challenge. This study deals with inequality path constraints by using the l(1) penalty function and a novel smoothing technique. After clarifying some theories of the proposed approach, a concomitant algorithm is also put forward and verified.
A new superlinearly convergent algorithm of combining QP subproblem with system of linear equations for nonlinear optimization

Jin-Bao Jian,Chuan-Hao Guo,Chun-Ming Tang,Yan-Qin Bai

DOI: https://doi.org/10.1016/j.cam.2014.06.009

IF: 2.872

2015-01-01

Journal of Computational and Applied Mathematics

Abstract:In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly convergent algorithm is proposed. The initial iteration point can be chosen arbitrarily for the algorithm. At each iteration, the new algorithm solves one quadratic programming subproblem which is always feasible, and one or two systems of linear equations with a common coefficient matrix. Moreover, the coefficient matrix is uniformly nonsingular. After finite iterations, the iteration points can always enter the feasible set of the problem, and the search direction is obtained by solving one quadratic programming subproblem and only one system of linear equations. The new algorithm possesses global and superlinear convergence under some suitable assumptions without the strict complementarity. Finally, some numerical results are reported to show that the algorithm is promising.

mathematics, applied
A Filled Function Method for Global Optimization with Inequality Constraints

Hongwei Lin,Yuping Wang,Yuelin Gao,Xiaoli Wang

DOI: https://doi.org/10.1007/s40314-016-0407-8

2016-01-01

Computational and Applied Mathematics

Abstract:In this paper, we propose a new filled function method for finding a global minimizer of global optimization with inequality constraints. The proposed filled function is a continuously differentiable function with only one parameter. Then, we can use classical local optimization methods to find a better minimizer of the proposed filled function with a few parameter adjustment. The numerical experiments are made and the results show that the proposed filled function method is effective.
A superlinearly convergent Newton-like algorithm for variational inequality problems with inequality constraints

Liping Zhang,Yanlian Lai

DOI: https://doi.org/10.1007/s001860000052

2000-01-01

Mathematical Methods of Operations Research

Abstract:. In this paper, a Newton-like method for variational inequality problems is considered. One feature of the algorithm is that only the solution of linear systems of equations is required at each iteration and that the strict complementarity assumption is never invoked. Another is that under mild assumptions, the sequence produced by the Newton-like method Q-superlinearly converges to the solution of the VIP. Furthermore, a simpler version of this method is studied and it is shown that it is also superlinearly convergent.
Superlinear Optimization Algorithms

Hongxia Wang,Yeming Xu,Ziyuan Guo,Huanshui Zhang

2024-03-17

Abstract:This paper proposes several novel optimization algorithms for minimizing a nonlinear objective function. The algorithms are enlightened by the optimal state trajectory of an optimal control problem closely related to the minimized objective function. They are superlinear convergent when appropriate parameters are selected as required. Unlike Newton's method, all of them can be also applied in the case of a singular Hessian matrix. More importantly, by reduction, some of them avoid calculating the inverse of the Hessian matrix or an identical dimension matrix and some of them need only the diagonal elements of the Hessian matrix. In these cases, these algorithms still outperform the gradient descent method. The merits of the proposed optimization algorithm are illustrated by numerical experiments.

Optimization and Control
A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

W Wang,LS Zhang,YF Xu

2005-01-01

Journal of Computational Mathematics

Abstract:A revised conjugate gradient projection method for nonlinear inequality constrained optimization problems is proposed in the paper, since the search direction is the combination of the conjugate projection gradient and the quasi-Newton direction. It has two merits. The one is that the amount of computation is lower because the gradient matrix only needs to be computed one time at each iteration. The other is that the algorithm is of global convergence and locally superlinear convergence without strict complementary condition under some mild assumptions. In addition the search direction is explicit.
Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Hu Yaohua,Li Chong,Wang Jinhua,Yang Xiaoqi,Zhu Linglingzhi

DOI: https://doi.org/10.1007/s00245-022-09957-x

2023-01-01

Abstract:We propose an inexact linearized proximal algorithm with an adaptive stepsize, together with its globalized version based on the backtracking line-search, to solve a convex composite optimization problem. Under the assumptions of local weak sharp minima of order p (p≥ 1) for the outer convex function and a quasi-regularity condition for the inclusion problem associated to the inner function, we establish superlinear/quadratic convergence results for proposed algorithms. Compared to the linearized proximal algorithms with a constant stepsize proposed in Hu et al. (SIAM J Optim 26(2):1207–1235, 2016), our algorithms own broader applications and higher convergence rates, and the idea of analysis used in the present paper deviates significantly from that of Hu et al. (2016). Numerical applications to the nonnegative inverse eigenvalue problem and the wireless sensor network localization problem indicate that the proposed algorithms are more efficient and robust, and outperform the algorithms in Hu et al. (2016) and some popular algorithms for relevant problems.
A Hybrid Genetic Algorithm for Solving Nonlinear Programming Problems with Inequality Constraints

Wei Lingyun,Chai Yueting,Zhao Mei

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.22.014

2006-01-01

Abstract:A hybrid genetic algorithm is proposed for global optimization of nonlinear programming problems with inequality constraints.The proposed algorithm consists of global exploration and local exploitation.In the global exploration phase,the simplex search is performed in those potential niches to quickly find the promising search domains.In the local exploitation,another simplex search is performed to quickly locate the global optimum in the located promising domain.The proposed method effectively alleviates premature convergence and improves weak exploitation capacity of genetic algorithms.Typical numerical examples are employed to demonstrate the efficiency,reliability and high accuracy of the proposed algorithm.
An Aggressive Reduction on the Complexity of Optimization for Non-Strongly Convex Objectives

Zhijian Luo,Siyu Chen,Yueen Hou,Yanzeng Gao,Yuntao Qian

DOI: https://doi.org/10.1142/s0219691323500170

2023-01-01

International Journal of Wavelets Multiresolution and Information Processing

Abstract:Tremendous efficient optimization methods have been proposed for strongly convex objectives optimization in modern machine learning. For non-strongly convex objectives, a popular approach is to apply a reduction from non-strongly convex to a strongly convex case via regularization techniques. Reduction on objectives with adaptive decrease on regularization tightens the optimal convergence of algorithms to be independent on logarithm factor. However, the initialization of parameter of regularization has a great impact on the performance of the reduction. In this paper, we propose an aggressive reduction to reduce the complexity of optimization for non-strongly convex objectives, and our reduction eliminates the impact of the initialization of parameter on the convergent performances of algorithms. Aggressive reduction not only adaptively decreases the regularization parameter, but also modifies regularization term as the distance between current point and the approximate minimizer. Our aggressive reduction can also shave off the non-optimal logarithm term theoretically, and make the convergent performance of algorithm more compact practically. Experimental results on logistic regression and image deblurring confirm this success in practice.
A new linearization technique for minimax linear fractional programming

Hongwei Jiao,Sanyang Liu

DOI: https://doi.org/10.1080/00207160.2013.860449

IF: 1.75

2014-01-16

International Journal of Computer Mathematics

Abstract:This paper presents a deterministic global optimization algorithm for solving minimax linear fractional programming (MLFP). In this algorithm, a new linearization technique is proposed, which uses more information of the objective function of the (MLFP) than other techniques. By utilizing this new linearization technique, the initial nonconvex programming problem (MLFP) is reduced to a sequence of linear relaxation programming (LRP) problems, which can provide reliable lower bound of the optimal value. The proposed algorithm is convergent to the global minimum of the (MLFP) through the successive refinement of the feasible region and solutions of a series of the (LRP). Compared with the known algorithms, numerical results show that the proposed algorithm is robust and effective.

mathematics, applied
Unconstrained Optimization Method for Solving Linear Inequalities

顾阿伦,孙永广,吴宗鑫,陈士俊

DOI: https://doi.org/10.3321/j.issn:1000-0054.2002.12.003

2002-01-01

Abstract:A class of unconstrained optimization methods were developed for solving linear inequalities that avoid computational instabilities or low efficiencies. A nonlinear optimization problem was constructed for the nonempty relative internal area of the feasible region of the related linear inequalities. An unconstrained optimization problem for dual space variables was then developed using simple linear mapping between the primary and the dual variables with the primary and dual principles. The linear inequalities problem was then transformed to an unconstrained optimization problem which was solved using Newton's method and the conjugate gradient method. The numeral results illustrate the effectiveness of the method.
An Algorithm for Solving the Global Optimization of Nonlinear Integer Programming

XIAO Jian,ZHANG Zhi-hong

DOI: https://doi.org/10.3969/j.issn.1673-1972.2006.06.011

2006-01-01

Abstract:This paper presents an algorithm to solve nonlinear integer programming problems.After finding out a discrete local minimal solution by using a genetic algorithm as a initial point,the algorithm tries to improve a discrete local minimal solution by minimizing a filled function.Finally,a global solution will be found after finite iterations.Numerical experiments show that this algorithm is efficient.
Variance reduced forward-reflected-backward algorithm for solving nonconvex finite-sum mixed variational inequalities

Mengjun Wang,Fuquan Xia

DOI: https://doi.org/10.3934/jimo.2024021

2024-02-28

Journal of Industrial and Management Optimization

Abstract:In this paper, we investigate a variance reduced forward-reflected-backward algorithm for solving nonconvex finite-sum mixed variational inequalities, where is Lipschitz continuous, is proper lower semicontinuous prox-convex, and they satisfy a generalized monotonicity condition on . We prove that the algorithm is almost surely convergent and exhibits -linear rate when is strongly monotone.

engineering, multidisciplinary,operations research & management science,mathematics, interdisciplinary applications

A Feasible and Superlinear Algorithm for Inequality Constrained Minimization Problems

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

A New Algorithm For Unconstrained Optimization Problem With The Form Of Sum Of Squares Minimization

A QP-FREE AND SUPERLINEARLY CONVERGENT ALGORITHM FOR INEQUALITY CONSTRAINEDOPTIMIZATIONS

A Mixed and Superlinearly Convergent Algorithm for Constrained Optimization.

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A New Method for Feasibility Analysis of Steady Constrained Optimization Systems

A MIXED SUPERLINEARLY CONVERGENT ALGORITHM WITH NONMONOTONE SEARCH FOR CONSTRAINED OPTIMIZATIONS

A Novel Penalty Approach for Nonlinear Dynamic Optimization Problems with Inequality Path Constraints

A new superlinearly convergent algorithm of combining QP subproblem with system of linear equations for nonlinear optimization

A Filled Function Method for Global Optimization with Inequality Constraints

A superlinearly convergent Newton-like algorithm for variational inequality problems with inequality constraints

Superlinear Optimization Algorithms

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A Hybrid Genetic Algorithm for Solving Nonlinear Programming Problems with Inequality Constraints

An Aggressive Reduction on the Complexity of Optimization for Non-Strongly Convex Objectives

A new linearization technique for minimax linear fractional programming

Unconstrained Optimization Method for Solving Linear Inequalities

An Algorithm for Solving the Global Optimization of Nonlinear Integer Programming

Variance reduced forward-reflected-backward algorithm for solving nonconvex finite-sum mixed variational inequalities