Complexity of Operators on Compact Sets.

Xishun Zhao

DOI: https://doi.org/10.1016/j.entcs.2008.03.011

2008-01-01

Electronic Notes in Theoretical Computer Science

Abstract:Based on oracle Turing machines, we investigate the computational complexity of operators on compact sets. For the projection and convex hull we are able to show exponential upper and lower bounds as well as a connection to the P=NP problem for special settings.

What problem does this paper attempt to address?

Information Complexity of Mixed-integer Convex Optimization

Amitabh Basu,Hongyi Jiang,Phillip Kerger,Marco Molinaro

DOI: https://doi.org/10.48550/arXiv.2308.11153

2023-08-22

Abstract:We investigate the information complexity of mixed-integer convex optimization under different types of oracles. We establish new lower bounds for the standard first-order oracle, improving upon the previous best known lower bound. This leaves only a lower order linear term (in the dimension) as the gap between the lower and upper bounds. This is derived as a corollary of a more fundamental ``transfer" result that shows how lower bounds on information complexity of continuous convex optimization under different oracles can be transferred to the mixed-integer setting in a black-box manner. Further, we (to the best of our knowledge) initiate the study of, and obtain the first set of results on, information complexity under oracles that only reveal \emph{partial} first-order information, e.g., where one can only make a binary query over the function value or subgradient at a given point. We give algorithms for (mixed-integer) convex optimization that work under these less informative oracles. We also give lower bounds showing that, for some of these oracles, every algorithm requires more iterations to achieve a target error compared to when complete first-order information is available. That is, these oracles are provably less informative than full first-order oracles for the purpose of optimization.

Optimization and Control
Complexity Concepts for Combinatorial and Continuous Optimization Problems

Wenxun XING

DOI: https://doi.org/10.15960/j.cnki.issn.1007-6093.2017.02.005

2017-01-01

Abstract:Complexity concepts oriented from the theoretical Turing machine are widely accepted in study of combinatorial optimization problems.The polynomially computable and NP-hard concepts are frequently used in recent papers on continuous optimization problems.This paper presents a very brief introduction to show their relationship and difference used in the two fields.
Computable Operators on Co-regular Subsets

QIU Yu-wen,ZHAO Xi-shun

DOI: https://doi.org/10.13413/j.cnki.jdxblxb.2008.03.002

2008-01-01

Abstract:For co-regular subsets in metric spaces,previous work has identified twelve distinct reasonable representations and its induced computability.With respect to those basic notions we investigated the computability of natural operations on co-regular sets: union,intersection,complement,the interior of a closed set,image and pre-image under suitable classes of functions.The results show that only few of these representations are uniformly computable in the sense of rendering all those operations.
Compact Operations on Model Spaces

Isabelle Chalendar,William T. Ross

DOI: https://doi.org/10.48550/arXiv.1603.01370

2016-03-04

Abstract:We give a characterization of the compact operators on a model space in terms of asymptotic Toeplitz operators.

Functional Analysis
PPAD-Completeness Oracle Model Complexity SPERNER 3 D : Papadimitriou ’ 94 [ 43 ] 2 D Lower bound : Crescenzi and Silvestri ’

Xiaotie Deng,Amin Saberi

2011-01-01

Abstract:In this work, we study three discrete fixed point concepts (SPERNER,DPZP,BROUWER) under two different models: the polynomial-time function model and the oracle function model. We fully characterize the computational complexities of these three problems. The computational complexity unification of the above problems gives us more choices in the study of different applications. As an example, by a reduction from DPZP, we derive asymptotically equal lower and upper bounds for TUCKER in the oracle model. The same reduction also allows us to derive a single proof for the PPAD-completeness of TUCKER in any constant dimension d, which is significantly simpler than the recent proof for the 2D case by Pálvölgyi, and for the 3D case and higher dimensions by Papadimitriou.
A Computational Proof of Complexity of Some Restricted Counting Problems

Jin-Yi Cai,Pinyan Lu,Mingji Xia

DOI: https://doi.org/10.1016/j.tcs.2010.10.039

2009-01-01

Abstract:We explore a computational approach to proving intractability of certain counting problems. More specifically we study the complexity of Holant of 3-regular graphs. These problems include concrete problems such as counting the number of vertex covers or independent sets for 3-regular graphs. The high level principle of our approach is algebraic, which provides sufficient conditions for interpolation to succeed. Another algebraic component is holographic reductions. We then analyze in detail polynomial maps on ℝ2 induced by some combinatorial constructions. These maps define sufficiently complicated dynamics of ℝ2 that we can only analyze them computationally. We use both numerical computation (as intuitive guidance) and symbolic computation (as proof theoretic verification) to derive that a certain collection of combinatorial constructions, in myriad combinations, fulfills the algebraic requirements of proving #P-hardness. The final result is a dichotomy theorem for a class of counting problems.
Complexity theory of orbit closure intersection for tensors: reductions, completeness, and graph isomorphism hardness

Vladimir Lysikov,Michael Walter

2024-11-07

Abstract:Many natural computational problems in computer science, mathematics, physics, and other sciences amount to deciding if two objects are equivalent. Often this equivalence is defined in terms of group actions. A natural question is to ask when two objects can be distinguished by polynomial functions that are invariant under the group action. For finite groups, this is the usual notion of equivalence, but for continuous groups like the general linear groups it gives rise to a new notion, called orbit closure intersection. It captures, among others, the graph isomorphism problem, noncommutative PIT, null cone problems in invariant theory, equivalence problems for tensor networks, and the classification of multiparty quantum states. Despite recent algorithmic progress in celebrated special cases, the computational complexity of general orbit closure intersection problems is currently quite unclear. In particular, tensors seem to give rise to the most difficult problems. In this work we start a systematic study of orbit closure intersection from the complexity-theoretic viewpoint. To this end, we define a complexity class TOCI that captures the power of orbit closure intersection problems for general tensor actions, give an appropriate notion of algebraic reductions that imply polynomial-time reductions in the usual sense, but are amenable to invariant-theoretic techniques, identify natural tensor problems that are complete for TOCI, including the equivalence of 2D tensor networks with constant physical dimension, and show that the graph isomorphism problem can be reduced to these complete problems, hence GI$\subseteq$TOCI. As such, our work establishes the first lower bound on the computational complexity of orbit closure intersection problems, and it explains the difficulty of finding unconditional polynomial-time algorithms beyond special cases, as has been observed in the literature.

Computational Complexity,Algebraic Geometry,Representation Theory
Complexity of Robust Orbit Problems for Torus Actions and the abc-conjecture

Peter Bürgisser,Mahmut Levent Doğan,Visu Makam,Michael Walter,Avi Wigderson

2024-05-24

Abstract:When a group acts on a set, it naturally partitions it into orbits, giving rise to orbit problems. These are natural algorithmic problems, as symmetries are central in numerous questions and structures in physics, mathematics, computer science, optimization, and more. Accordingly, it is of high interest to understand their computational complexity. Recently, Bürgisser et al. gave the first polynomial-time algorithms for orbit problems of torus actions, that is, actions of commutative continuous groups on Euclidean space. In this work, motivated by theoretical and practical applications, we study the computational complexity of robust generalizations of these orbit problems, which amount to approximating the distance of orbits in $\mathbb{C}^n$ up to a factor $\gamma>1$. In particular, this allows deciding whether two inputs are approximately in the same orbit or far from being so. On the one hand, we prove the NP-hardness of this problem for $\gamma = n^{\Omega(1/\log\log n)}$ by reducing the closest vector problem for lattices to it. On the other hand, we describe algorithms for solving this problem for an approximation factor $\gamma = \exp(\mathrm{poly}(n))$. Our algorithms combine tools from invariant theory and algorithmic lattice theory, and they also provide group elements witnessing the proximity of the given orbits (in contrast to the algebraic algorithms of prior work). We prove that they run in polynomial time if and only if a version of the famous number-theoretic $abc$-conjecture holds -- establishing a new and surprising connection between computational complexity and number theory.

Computational Complexity,Data Structures and Algorithms,Algebraic Geometry,Representation Theory
On Lower Complexity Bounds for Large-Scale Smooth Convex Optimization

Cristobal Guzman,Arkadi Nemirovski

DOI: https://doi.org/10.48550/arXiv.1307.5001

2018-11-28

Abstract:We derive lower bounds on the black-box oracle complexity of large-scale smooth convex minimization problems, with emphasis on minimizing smooth (with Holder continuous, with a given exponent and constant, gradient) convex functions over high-dimensional ||.||_p-balls, 1<=p<=\infty. Our bounds turn out to be tight (up to logarithmic in the design dimension factors), and can be viewed as a substantial extension of the existing lower complexity bounds for large-scale convex minimization covering the nonsmooth case and the 'Euclidean' smooth case (minimization of convex functions with Lipschitz continuous gradients over Euclidean balls). As a byproduct of our results, we demonstrate that the classical Conditional Gradient algorithm is near-optimal, in the sense of Information-Based Complexity Theory, when minimizing smooth convex functions over high-dimensional ||.||_\infty-balls and their matrix analogies -- spectral norm balls in the spaces of square matrices.

Optimization and Control,Computational Complexity
A correspondence between the time and space complexity

Ivan V. Latkin

2023-11-02

Abstract:We investigate the correspondence between the time and space recognition complexity of languages; for this purpose, we will code the long-continued computations of deterministic two-tape Turing machines by the relatively short-length quantified Boolean formulae. The modified Stockmeyer and Meyer method will appreciably be used for this simulation. It will be proved using this modeling that the complexity classes $\mathbf{EXP}$ and $\mathbf{PSPACE}$ coincide; and more generally, the class $(k\!+\!1)$-fold Deterministic Exponential Time equals to the class $k$-fold Deterministic Exponential Space for each $k\geqslant1$; the space complexity of the languages of the class $\mathbf{P}$ will also be studied. Furthermore, this allows us to slightly improve the early founded lower complexity bound of decidable theories that are nontrivial relative to some equivalence relation (this relation may be equality) -- each of these theories is consistent with the formula, which asserts that there are two non-equivalent elements. Keywords: computational complexity, the coding of computations through formulae, exponential time, polynomial space, lower complexity bound of the language recognition

Computational Complexity,Logic in Computer Science,Logic
On the Compactness of Commutators of Hardy Operators

Shaoguang Shi,Zunwei Fu,Shanzhen Lu

DOI: https://doi.org/10.2140/pjm.2020.307.239

2020-01-01

Pacific Journal of Mathematics

Abstract:We focus on the need for the compactness characterizations of the commutators of Hardy operators. More precisely, we prove that the commutators of Hardy operators, including the fractional Hardy operator, are compact operators on L-p(R-n) (1 < p < infinity) spaces if and only if the symbol functions of the commutators belong to CVMO(R-n) spaces (the central BMO (R-n) closure of C-c(infinity)(R-n)).
Discrete Fixed Points: Models, Complexities, and Applications

Xiaotie Deng,Qi,Amin Saberi,Jie Zhang

DOI: https://doi.org/10.1287/moor.1110.0511

IF: 2.215

2011-01-01

Mathematics of Operations Research

Abstract:We study three discrete fixed point concept (SPERNER, DPZP, BROUWER) under two different models: the polynomial-time function model and the oracle function model. We fully characterize the computational complexities of these three problems. The computational complexity unification of the above problems gives us more choices in the study of different applications. As an example, by a reduction from DPZP, we derive asymptotically equal lower and upper bound for TUCKER in the oracle model. The same reduction also allows us to derive a single proof for the PPAD-completeness of TUCKER in any constant dimension, which is significantly simpler than the recent proofs.
Lower Bounds on the Oracle Complexity of Nonsmooth Convex Optimization via Information Theory

Gábor Braun,Cristóbal Guzmán,Sebastian Pokutta

DOI: https://doi.org/10.1109/TIT.2017.2701343

2023-07-07

Abstract:We present an information-theoretic approach to lower bound the oracle complexity of nonsmooth black box convex optimization, unifying previous lower bounding techniques by identifying a combinatorial problem, namely string guessing, as a single source of hardness. As a measure of complexity we use distributional oracle complexity, which subsumes randomized oracle complexity as well as worst-case oracle complexity. We obtain strong lower bounds on distributional oracle complexity for the box $[-1,1]^n$, as well as for the $L^p$-ball for $p \geq 1$ (for both low-scale and large-scale regimes), matching worst-case upper bounds, and hence we close the gap between distributional complexity, and in particular, randomized complexity, and worst-case complexity. Furthermore, the bounds remain essentially the same for high-probability and bounded-error oracle complexity, and even for combination of the two, i.e., bounded-error high-probability oracle complexity. This considerably extends the applicability of known bounds.

Optimization and Control,Computational Complexity,Information Theory
Extrapolation of Compactness on Banach Function Spaces

Emiel Lorist,Zoe Nieraeth

DOI: https://doi.org/10.1007/s00041-024-10087-x

2024-05-08

Journal of Fourier Analysis and Applications

Abstract:We prove an extrapolation of compactness theorem for operators on Banach function spaces satisfying certain convexity and concavity conditions. In particular, we show that the boundedness of an operator T in the weighted Lebesgue scale and the compactness of T in the unweighted Lebesgue scale yields compactness of T on a very general class of Banach function spaces. As our main new tool, we prove various characterizations of the boundedness of the Hardy-Littlewood maximal operator on such spaces and their associate spaces, using a novel sparse self-improvement technique. We apply our main results to prove compactness of the commutators of singular integral operators and pointwise multiplication by functions of vanishing mean oscillation on, for example, weighted variable Lebesgue spaces.

mathematics, applied
More On Convexity And Smoothness Of Operators

Lixin Cheng,Qingjin Cheng

DOI: https://doi.org/10.1016/j.jmaa.2010.05.036

IF: 1.417

2010-01-01

Journal of Mathematical Analysis and Applications

Abstract:Let X and V be Banach spaces and T Y -> X be a bounded operator In this note, we show first some operator versions of the dual relation between q-convexity and p-smoothness of Banach spaces case. Making use of them, we prove then the main result of this note that the two notions of uniform q-convexity and uniform p-smoothness of an operator T introduced by J. Wenzel are actually equivalent to that the corresponding T-modulus delta(T) of convexity and the T-modulus rho(T) of smoothness introduced by G Pisier are of power type q and of power type p. respectively. This is also an operator version of a combination of a Hoffman's theorem and a Figiel-Pisier's theorem As their application, we show finally that a recent theorem of J Borwein, A.J Guirao, P. Hajek and J. Vanderwerff about q-convexity of Banach spaces is again valid for q-convexity of operators (C) 2010 Elsevier Inc All rights reserved
On combinatorial compexity of convex sequences

A. Iosevich,M. Rudnev,V. Ten

DOI: https://doi.org/10.48550/arXiv.math/0311297

2003-11-18

Abstract:We obtain a good upper bound on the number of solutions of a diophantine equation arising from a strictly convex sequences of real numbers.

Combinatorics,Classical Analysis and ODEs
Lower bounds for algebraic computation trees with integer inputs

Andrew Chi-Chih Yao

DOI: https://doi.org/10.1137/0220041

1991-01-01

SIAM Journal on Computing

Abstract:Let $W \subseteq R^n $ be scale-invariant and rationally dispersed, i.e., $\tilde x \in W$ implies $\lambda \tilde x \in W$ for all real $\lambda > 0$; and the rationale are dense in both W and $R^n - W$. It is shown that, in the algebraic computation tree model, the problem of deciding whether an input $\tilde x \in R^n $ with integer coordinates is a member of W has complexity $\Omega (\log _2 \hat \beta (W) - 2n)$, where $\hat \beta (W)$ is the number of connected components of W that are not of measure 0. This theorem can be used to prove tight lower bounds for the integral-constrained form of many basic problems, such as Element Distinctness, Set Disjointness, Finding Convex Hull, etc. Through further transformations, it leads to lower bounds for problems such as Integer Max Gap and Closest Pair of a simple polygon. The proof involves a nontrivial extension of the Milnor–Thorn techniques for finding upper bounds on the Betti numbers of algebraic varieties.
The operator theory on complete partially ordered objects in a topos

Tao LU,Xi-juan WANG,Wei HE

DOI: https://doi.org/10.6040/j.issn.1671-9352.0.2015.481

2016-01-01

Abstract:The concept of the projective operators between complete partially ordered objects in a topos is investigated. The characterizations of the closure operator and the kernel operator in a topos are given,which are common generaliza-tions of the classical lattice theory.
On the complexity of Chow and Hurwitz forms

Mahmut Levent Doğan,Alperen Ali Ergür,Elias Tsigaridas

DOI: https://doi.org/10.1145/3653002.3653003

2024-04-13

Abstract:We consider the bit complexity of computing Chow forms and their generalization to multiprojective spaces. We develop a deterministic algorithm using resultants and obtain a single exponential complexity upper bound. Earlier computational results for Chow forms were in the arithmetic complexity model, and our result represents the first bit complexity bound. We also extend our algorithm to Hurwitz forms in projective space, and explore connections between multiprojective Hurwitz forms and matroid theory. The motivation for our work comes from incidence geometry where intriguing computational algebra problems remain open.

Computational Complexity,Symbolic Computation,Algebraic Geometry
Compact Operators Via The Berezin Transform

Sheldon Axler,Dechao Zheng

DOI: https://doi.org/10.1512/iumj.1998.47.1407

1998-01-01

Indiana University Mathematics Journal

Abstract:In this paper we prove that if S equals a finite sum of finite products of Toeplitz operators on the Bergman space of the unit disk, then S is compact if and only if the Berezin transform of S equals 0 on partial derivative D. This result is new even when S equals a single Toeplitz operator. Our main result can be used to prove, via a unified approach, several previously known results about compact Toeplitz operators, compact Hankel operators, and appropriate products of these operators.

Complexity of Operators on Compact Sets.

Information Complexity of Mixed-integer Convex Optimization

Complexity Concepts for Combinatorial and Continuous Optimization Problems

Computable Operators on Co-regular Subsets

Compact Operations on Model Spaces

PPAD-Completeness Oracle Model Complexity SPERNER 3 D : Papadimitriou ’ 94 [ 43 ] 2 D Lower bound : Crescenzi and Silvestri ’

A Computational Proof of Complexity of Some Restricted Counting Problems

Complexity theory of orbit closure intersection for tensors: reductions, completeness, and graph isomorphism hardness

Complexity of Robust Orbit Problems for Torus Actions and the abc-conjecture

On Lower Complexity Bounds for Large-Scale Smooth Convex Optimization

A correspondence between the time and space complexity

On the Compactness of Commutators of Hardy Operators

Discrete Fixed Points: Models, Complexities, and Applications

Lower Bounds on the Oracle Complexity of Nonsmooth Convex Optimization via Information Theory

Extrapolation of Compactness on Banach Function Spaces

More On Convexity And Smoothness Of Operators

On combinatorial compexity of convex sequences

Lower bounds for algebraic computation trees with integer inputs

The operator theory on complete partially ordered objects in a topos

On the complexity of Chow and Hurwitz forms

Compact Operators Via The Berezin Transform