Dynamical Systems Method for ill-posed equations with monotone operators

A.G.Ramm

DOI: https://doi.org/10.1016/j.cnsns.2003.07.002

2004-09-19

Abstract: Consider an operator equation (*) $B(u)-f=0$ in a real Hilbert space.

Functional Analysis

What problem does this paper attempt to address?

Iterative solution of linear equations with unbounded operators

A.G.Ramm

DOI: https://doi.org/10.48550/arXiv.math/0601300

2006-01-13

Abstract:A convergent iterative process is constructed for solving any solvable linear equation in a Hilbert space.

Numerical Analysis,Functional Analysis
Third Order Dynamical Systems for the Sum of Two Generalized Monotone Operators

DOI: https://doi.org/10.1007/s10957-024-02437-y

2024-06-03

Journal of Optimization Theory and Applications

Abstract:In this paper, we propose and analyze a third-order dynamical system for finding zeros of the sum of two generalized operators in a Hilbert space . We establish the existence and uniqueness of the trajectories generated by the system under appropriate continuity conditions, and prove exponential convergence to the unique zero when the sum of the operators is strongly monotone. Additionally, we derive an explicit discretization of the dynamical system, which results in a forward–backward algorithm with double inertial effects and larger range of stepsize. We establish the linear convergence of the iterates to the unique solution using this algorithm. Furthermore, we provide convergence analysis for the class of strongly pseudo-monotone variational inequalities. We illustrate the effectiveness of our approach by applying it to structured optimization and pseudo-convex optimization problems.

mathematics, applied,operations research & management science
On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

Antonio Leitão,Joel C. Rabelo,Dirk A. Lorenz,Maximilian Winkler

2024-06-11

Abstract:In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results are: monotonicity and convergence for exact data, stability and semi-convergence for noisy data. Regarding numerical experiments we consider: i) a parameter identification problem in elliptic PDEs, ii) a parameter identification problem in machine learning; the computational efficiency of the proposed method is compared with canonical implementations of the LM method.

Numerical Analysis
Local Well-Posedness And Ill-Posedness On The Equation Of Type Square U = U(K)(Partial Derivative U)(Alpha)

Daoyuan Fang,Chengbo Wang

DOI: https://doi.org/10.1142/S0252959905000294

2005-01-01

Chinese Annals of Mathematics Series B

Abstract:This paper undertakes a systematic treatment of the low regularity local well-posedness and ill-posedness theory in H-s and H-s for semilinear wave equations with polynomial nonlinearity in u and partial derivative u. This ill-posed result concerns the focusing type equations with nonlinearity on u and partial derivative(t)u.
DSM for solving ill-conditioned linear algebraic systems

A.G.Ramm

DOI: https://doi.org/10.48550/arXiv.math/0601299

2006-01-13

Abstract:A standard way to solve linear algebraic systems $Au=f,\,\,(*)$ with ill-conditioned matrices $A$ is to use variational regularization. This leads to solving the equation $(A^*A+aI)u=A^*f_\d$, where $a$ is a regularization parameter, and $f_\d$ are noisy data, $||f-f_\d||\leq \d$. Numerically it requires to calculate products of matrices $A^*A$ and inversion of the matrix $A^*A+aI$ which is also ill-conditioned if $a>0$ is small. We propose a new method for solving (*) stably, given noisy data $f_\d$. This method, the DSM (Dynamical Systems Method) is developed in this paper for selfadjoint $A$. It consists in solving a Cauchy problem for systems of ordinary differential equations.

Numerical Analysis,Functional Analysis
Monotonicity and Nonexistence Results to Cooperative Systems in the Half Space

Zhijie Chen,Chang-Shou Lin,Wenming Zou

DOI: https://doi.org/10.1016/j.jfa.2013.08.021

IF: 1.891

2014-01-01

Journal of Functional Analysis

Abstract:In this paper, we prove the monotonicity and nonexistence of positive bounded solutions to an elliptic system in the half space R+n:Δu+f(u,v)=0Δv+g(u,v)=0in R+n,u=v=0on ∂R+n, where fv⩾0, gu⩾0 and both f and g are convex functions.
Hilbert Direct Integrals of Monotone Operators

Minh N. Bùi,Patrick L. Combettes

DOI: https://doi.org/10.4153/S0008414X2400049X

2024-08-13

Abstract:Finite Cartesian products of operators play a central role in monotone operator theory and its applications. Extending such products to arbitrary families of operators acting on different Hilbert spaces is an open problem, which we address by introducing the Hilbert direct integral of a family of monotone operators. The properties of this construct are studied and conditions under which the direct integral inherits the properties of the factor operators are provided. The question of determining whether the Hilbert direct integral of a family of subdifferentials of convex functions is itself a subdifferential leads us to introducing the Hilbert direct integral of a family of functions. We establish explicit expressions for evaluating the Legendre conjugate, subdifferential, recession function, Moreau envelope, and proximity operator of such integrals. Next, we propose a duality framework for monotone inclusion problems involving integrals of linearly composed monotone operators and show its pertinence towards the development of numerical solution methods. Applications to inclusion and variational problems are discussed.

Functional Analysis,Optimization and Control
Regularized dynamics for monotone inverse variational inequalities in hilbert spaces

Pham Ky Anh,Trinh Ngoc Hai

DOI: https://doi.org/10.1007/s11081-024-09882-8

IF: 2.619

2024-03-19

Optimization and Engineering

Abstract:In this paper, we present a regularized dynamical system method for solving monotone inverse variational inequalities (IVIs) in infinite dimensional Hilbert spaces. It is shown that the corresponding Cauchy problem admits a unique strong global solution, whose limit at infinity exists and solves the given monotone IVI. Then by discretizing the dynamical system, we obtain a class of iterative regularization algorithms with relaxation parameters, which are strongly convergent under quite mild assumptions on the cost operator. Some simple numerical examples, including an infinite dimensional one, are given to illustrate the performance of the proposed algorithms.

engineering, multidisciplinary,operations research & management science,mathematics, interdisciplinary applications
Existence For Nonlinear Evolution Equations And Application To Degenerate Parabolic Equation

Ning Su,Li Zhang

DOI: https://doi.org/10.1155/2014/567241

2014-01-01

Journal of Applied Mathematics

Abstract:We consider an abstract Cauchy problem for a doubly nonlinear evolution equation of the form (d/dt) A(u) + B(u) (sic) f(t) in V', t epsilon (0, T], where T is a real reflexive Banach space, A and B are maximal monotone operators (possibly multivalued) from A to its dual V'. In view of some practical applications, we assume that A and B are subdifferentials. By using the back difference approximation, existence is established, and our proof relies on the continuity of A and the coerciveness of B. As an application, we give the existence for a nonlinear degenerate parabolic equation.
Comparing the ill-posedness for linear operators in Hilbert spaces

Peter Mathé,Bernd Hofmann

2024-10-23

Abstract:The difficulty for solving ill-posed linear operator equations in Hilbert space is reflected by the strength of ill-posedness of the governing operator, and the inherent solution smoothness. In this study we focus on the ill-posedness of the operator, and we propose a partial ordering for the class of all bounded linear operators which lead to ill-posed operator equations. For compact linear operators, there is a simple characterization in terms of the decay rates of the singular values. In the context of the validity of the spectral theorem the partial ordering can also be understood. We highlight that range inclusions yield partial ordering, and we discuss cases when compositions of compact and non-compact operators occur. Several examples complement the theoretical results.

Numerical Analysis,Functional Analysis
A fixed-time stable forward-backward dynamical system for solving generalized monotone inclusions

Nam V Tran,Hai T. T. Le,An V. Truong,Vuong T. Phan

2024-07-11

Abstract:We propose a forward-backward splitting dynamical system for solving inclusion problems of the form $0\in A(x)+B(x)$ in Hilbert spaces, where $A$ is a maximal operator and $B$ is a single-valued operator. Involved operators are assumed to satisfy a generalized monotonicity condition, which is weaker than the standard monotone assumptions. Under mild conditions on parameters, we establish the fixed-time stability of the proposed dynamical system. In addition, we consider an explicit forward Euler discretization of the dynamical system leading to a new forward backward algorithm for which we present the convergence analysis. Applications to other optimization problems such as Constrained Optimization Problems (COPs), Mixed Variational Inequalities (MVIs), and Variational Inequalities (VIs) are presented and some numerical examples are given to illustrate the theoretical results.

Optimization and Control
Error estimates for simplified Levenberg–Marquardt method for nonlinear ill-posed operator equations in Hilbert Spaces

Pallavi Mahale,Ankush Kumar

DOI: https://doi.org/10.1515/jiip-2023-0090

IF: 1.4479

2024-06-26

Journal of Inverse and Ill-Posed Problems

Abstract:In this paper, we consider the simplified Levenberg–Marquardt method for nonlinear ill-posed inverse problems in Hilbert spaces for obtaining stable approximations of solutions to the ill-posed nonlinear equations of the form F ⁢ ( u ) = y , where F : D ⁢ ( F ) ⊂ U → Y is a nonlinear operator between Hilbert spaces U and Y . The method is defined as follows: where T 0 = F ′ ⁢ ( u 0 ) and T 0 ∗ = F ′ ⁢ ( u 0 ) ∗ . Here F ′ ⁢ ( u 0 ) denotes the Frèchet derivative of F at an initial guess u 0 ∈ D ⁢ ( F ) for the exact solution u † , F ′ ⁢ ( u 0 ) ∗ is the adjoint of F ′ ⁢ ( u 0 ) and { α n } is an a priori chosen sequence of non-negative real numbers satisfying suitable properties. We use Morozov-type stopping rule to terminate the iterations. Under suitable non-linearity conditions on operator F , we show convergence of the method and also obtain a convergence rate result under a Hölder-type source condition on the element u 0 - u † . Furthermore, we derive convergence of the method for the case when no source conditions are used and the study concludes with numerical examples which validate the theoretical conclusions.

mathematics, applied
A unified concept of the degree of ill-posedness for compact and non-compact linear operator equations in Hilbert spaces under the auspices of the spectral theorem

Frank Werner,Bernd Hofmann

2024-11-26

Abstract:Covering ill-posed problems with compact and non-compact operators regarding the degree of ill-posedness is a never ending story written by many authors in the inverse problems literature. This paper tries to add a new narrative and some new facets with respect to this story under the auspices of the spectral theorem. The latter states that any self-adjoint and bounded operator is unitarily equivalent to a multiplication operator on some (semi-finite) measure space. We will exploit this fact and derive a distribution function from the corresponding multiplier, the growth behavior of which at zero allows us to characterize the degree of ill-posedness. We prove that this new concept coincides with the well-known one for compact operators (by means of their singular values), and illustrate the implications along examples including the Hausdorff moment operator and convolutions.

Numerical Analysis
A second order dynamical system method for solving a maximal comonotone inclusion problem

Zengzhen Tan,Rong Hu,Yaping Fang

2023-07-07

Abstract:In this paper a second order dynamical system model is proposed for computing a zero of a maximal comonotone operator in Hilbert spaces. Under mild conditions, we prove existence and uniqueness of a strong global solution of the proposed dynamical system. A proper tuning of the parameters can allow us to establish fast convergence properties of the trajectories generated by the dynamical system. The weak convergence of the trajectory to a zero of the maximal comonotone operator is also proved. Furthermore, a discrete version of the dynamical system is considered and convergence properties matching to that of the dynamical system are established under a same framework. Finally, the validity of the proposed dynamical system and its discrete version is demonstrated by two numerical examples.

Optimization and Control
On a class of doubly nonlinear evolution equations in Musielak–Orlicz spaces

Goro Akagi,Giulio Schimperna

DOI: https://doi.org/10.1002/mana.202300374

2024-03-28

Mathematische Nachrichten

Abstract:This paper is concerned with a parabolic evolution equation of the form A(ut)+B(u)=f , settled in a smooth bounded domain of Rd , d≥1 , and complemented with the initial conditions and with (for simplicity) homogeneous Dirichlet boundary conditions. Here, −B stands for a diffusion operator, possibly nonlinear, which may range in a very wide class, including the Laplacian, the m ‐Laplacian for suitable m∈(1,∞) , the "variable‐exponent" m(x) ‐Laplacian, or even some fractional order operators. The operator A is assumed to be in the form [A(v)](x,t)=α(x,v(x,t)) with α being measurable in x and maximal monotone in v . The main results are devoted to proving existence of weak solutions for a wide class of functions α that extends the setting considered in previous results related to the variable exponent case where α(x,v)=|v(x)|p(x)−2v(x) . To this end, a theory of subdifferential operators will be established in Musielak–Orlicz spaces satisfying structure conditions of the so‐called Δ2 ‐type, and a framework for approximating maximal monotone operators acting in that class of spaces will also be developed. Such a theory is then applied to provide an existence result for a specific equation, but it may have an independent interest in itself. Finally, the existence result is illustrated by presenting a number of specific equations (and, correspondingly, of operators A , B ) to which the result can be applied.

mathematics
Variational and numerical aspects of a system of ODEs with concave-convex nonlinerities

Oscar Agudelo,Gabriela Holubová,Martin Kudláč

2024-08-20

Abstract:In this work we discuss a Hamiltonian system of ordinary differential equations under Dirichlet boundary conditions. The system of equations in consideration features a mixed (concave-convex) power nonlinearity depending on a positive parameter $\lambda$. We show multiplicity of nonnegative solutions of the system for a certain range of the parameter $\lambda$ and we also discuss regularity and symmetry of nonnegative solutions of the system. Besides, we present a numerical strategy aiming at the exploration of the optimal range of $\lambda$ for which multiplicity of solutions holds. The numerical experiments are based on the Poincaré-Miranda theorem and the shooting method, which have been lesser explored for systems of ODEs. Our work is motivated by the works of Ambrosetti et al., 1994 and Moreira dos Santos, 2009.

Functional Analysis
Quasilinear Dirichlet systems with competing operators and convection

L. Gambera,S.A. Marano,D. Motreanu

2023-05-06

Abstract:In this paper, we consider a quasi-linear Dirichlet system with possible competing $(p,q)$-Laplacians and convections. Due to the lack of ellipticity, monotonicity, and variational structure, the standard approaches to the existence of weak solutions cannot be adopted. Nevertheless, through an approximation procedure and a corollary of Brouwer's fixed point theorem we show that the problem admits a solution in a suitable sense.

Analysis of PDEs
A third order dynamical system for generalized monotone equation

Pham Viet Hai,Phan Tu Vuong

2024-06-02

Abstract:We propose a third order dynamical system for solving a nonlinear equation in Hilbert spaces where the operator is cocoercive with respect to the solutions set. Under mild conditions on the parameters, we establish the existence and uniqueness of the generated trajectories as well as its asymptotic convergence to a solution of the equation. When the operator is strongly monotone with respect to the solutions set, we deliver an exponential convergence rate of $e^{-2t}$, which is significantly faster than the known results of second order dynamical systems. In particular, for convex optimization problems, the proposed dynamical system provides a fast convergence rate of {\bf $\mathcal{O}(\frac{1}{t^3})$} for the objective values. In addition, we discuss the applications of the proposed dynamical system to several splitting monotone inclusion problems.

Optimization and Control
Monotonicity of solutions for parabolic equations involving nonlocal Monge-Ampère operator

Guangwei Du,Xinjing Wang

DOI: https://doi.org/10.1515/anona-2023-0135

IF: 4.5438

2024-01-01

Advances in Nonlinear Analysis

Abstract:Abstract In this article, we consider the parabolic equations with nonlocal Monge-Ampère operators ∂ u ∂ t ( x , t ) − D s θ u ( x , t ) = f ( u ( x , t ) ) , ( x , t ) ∈ R + n × R . \frac{\partial u}{\partial t}\left(x,t)-{D}_{s}^{\theta }u\left(x,t)=f\left(u\left(x,t)),\hspace{1.0em}\left(x,t)\in {{\mathbb{R}}}_{+}^{n}\times {\mathbb{R}}. We first prove the narrow region principle and maximal principle for antisymmetric functions, under the condition that u u is uniformly bounded, which weaken the general decay condition u → 0 u\to 0 at infinity. Then, the monotonicity of positive solutions is established using the method of moving planes.

mathematics, applied
Monotone and Pseudo-Monotone Equilibrium Problems in Hadamard Spaces

Hadi Khatibzadeh,Vahid Mohebbi

DOI: https://doi.org/10.48550/arXiv.1611.01829

2016-11-07

Abstract:We study equilibrium problems in Hadamard spaces, which extend variational inequalities and many other problems in nonlinear analysis. In this paper, first we study the existence of solutions of equilibrium problems associated with pseudo-monotone bifunctions with suitable conditions on the bifunctions in Hadamard spaces. Then to approximate of an equilibrium point, we consider the proximal point algorithm for pseudo-monotone bifunctions. We prove existence of the sequence generated by the algorithm in several cases in Hadamard spaces. Next, we introduce the resolvent of a bifunction in Hadamard spaces. We prove convergence of the resolvent to an equilibrium point. We also prove $\bigtriangleup$-convergence of the sequence generated by the proximal point algorithm to an equilibrium point of the pseudo-monotone bifunction and also the strong convergence with additional assumptions on the bifunction. Finally, we study a regularization of Halpern type and prove the strong convergence of the generated sequence to an equilibrium point without any additional assumption on the pseudo-monotone bifunction. Some examples in fixed point theory and convex minimization are also presented.

Functional Analysis

Dynamical Systems Method for ill-posed equations with monotone operators

Iterative solution of linear equations with unbounded operators

Third Order Dynamical Systems for the Sum of Two Generalized Monotone Operators

On inertial Levenberg-Marquardt type methods for solving nonlinear ill-posed operator equations

Local Well-Posedness And Ill-Posedness On The Equation Of Type Square U = U(K)(Partial Derivative U)(Alpha)

DSM for solving ill-conditioned linear algebraic systems

Monotonicity and Nonexistence Results to Cooperative Systems in the Half Space

Hilbert Direct Integrals of Monotone Operators

Regularized dynamics for monotone inverse variational inequalities in hilbert spaces

Existence For Nonlinear Evolution Equations And Application To Degenerate Parabolic Equation

Comparing the ill-posedness for linear operators in Hilbert spaces

A fixed-time stable forward-backward dynamical system for solving generalized monotone inclusions

Error estimates for simplified Levenberg–Marquardt method for nonlinear ill-posed operator equations in Hilbert Spaces

A unified concept of the degree of ill-posedness for compact and non-compact linear operator equations in Hilbert spaces under the auspices of the spectral theorem

A second order dynamical system method for solving a maximal comonotone inclusion problem

On a class of doubly nonlinear evolution equations in Musielak–Orlicz spaces

Variational and numerical aspects of a system of ODEs with concave-convex nonlinerities

Quasilinear Dirichlet systems with competing operators and convection

A third order dynamical system for generalized monotone equation

Monotonicity of solutions for parabolic equations involving nonlocal Monge-Ampère operator

Monotone and Pseudo-Monotone Equilibrium Problems in Hadamard Spaces