On Parameterized Approximability.

Yijia Chen,Martin Grohe,Magdalena Grüber

DOI: https://doi.org/10.1007/11847250_10

2007-01-01

Abstract:Combining classical approximability questions with parameterized complexity, we introduce a theory of parameterized approximability. The main intention of this theory is to deal with the efficient approximation of small cost solutions for optimisation problems.

What problem does this paper attempt to address?

On the Optimality of Exact and Approximation Algorithms for Scheduling Problems.

Lin Chen,Deshi Ye,Guochuan Zhang

DOI: https://doi.org/10.1016/j.jcss.2018.03.005

IF: 1.043

2018-01-01

Journal of Computer and System Sciences

Abstract:We consider the classical scheduling problem on parallel identical machines to minimize the makespan. There is a long history of study on this problem, focusing on exact and approximation algorithms. It is thus natural to consider whether these algorithms can be further improved in terms of running times. We provide strong lower bounds on the running times of exact and approximation schemes for the classical scheduling problem based on Exponential Time Hypothesis, showing that the best known approximation and exact algorithms are almost the best possible in terms of the running time.
Parameterized and Approximation Results for Scheduling with a Low Rank Processing Time Matrix.

Lin Chen,Daniel Marx,Deshi Ye,Guochuan Zhang

DOI: https://doi.org/10.4230/lipics.stacs.2017.22

2017-01-01

Abstract:We study approximation and parameterized algorithms for R vertical bar vertical bar C-max, focusing on the problem when the rank of the matrix formed by job processing times is small. Bhaskara et al. [2] initiated the study of approximation algorithms with respect to the rank, showing that R vertical bar vertical bar C-max admits a QPTAS (Quasi-polynomial time approximation scheme) when the rank is 2, and becomes APX-hard when the rank is 4.We continue this line of research. We prove that R vertical bar vertical bar C(max )is APX-hard even if the rank is 3, resolving an open problem in [2]. We then show that R vertical bar vertical bar C-max is FPT parameterized by the rank and the largest job processing time p(maz). This generalizes the parameterized results on P vertical bar vertical bar C-max [17] and R vertical bar vertical bar C-max with few different types of machines [15]. We also provide nearly tight lower bounds under Exponential Time Hypothesis which suggests that the running time of the FPT algorithm is unlikely to be improved significantly.
Fixed-Parameter and Approximation Algorithms: A New Look

Rajesh Chitnis,MohammadTaghi Hajiaghayi,Guy Kortsarz

DOI: https://doi.org/10.48550/arXiv.1308.3520

2013-08-15

Data Structures and Algorithms

Abstract:A Fixed-Parameter Tractable (\FPT) $\rho$-approximation algorithm for a minimization (resp. maximization) parameterized problem $P$ is an FPT algorithm that, given an instance $(x, k)\in P$ computes a solution of cost at most $k \cdot \rho(k)$ (resp. $k/\rho(k)$) if a solution of cost at most (resp. at least) $k$ exists; otherwise the output can be arbitrary. For well-known intractable problems such as the W[1]-hard {Clique} and W[2]-hard {Set Cover} problems, the natural question is whether we can get any \FPT-approximation. It is widely believed that both {Clique} and {Set-Cover} admit no FPT $\rho$-approximation algorithm, for any increasing function $\rho$. Assuming standard conjectures such as the Exponential Time Hypothesis (ETH) \cite{eth-paturi} and the Projection Games Conjecture (PGC) \cite{r3}, we make the first progress towards proving this conjecture by showing that 1. Under the ETH and PGC, there exist constants $F_1, F_2 >0$ such that the {Set Cover} problem does not admit an FPT approximation algorithm with ratio $k^{F_1}$ in $2^{k^{F_2}}\cdot \text{poly}(N,M)$ time, where $N$ is the size of the universe and $M$ is the number of sets. 2. Unless $\NP\subseteq \SUBEXP$, for every $1> \delta > 0$ there exists a constant $F(\delta)>0$ such that {Clique} has no FPT cost approximation with ratio $k^{1-\delta}$ in $2^{k^{F}}\cdot \text{poly}(n)$ time, where $n$ is the number of vertices in the graph. In the second part of the paper we consider various W[1]-hard problems such as {\dst}, {\dsf}, Directed Steiner Network and {\mec}. For all these problem we give polynomial time $f(\text{OPT})$-approximation algorithms for some small function $f$ (the largest approximation ratio we give is $\text{OPT}^2$).
Counting Problems in Parameterized Complexity

Chihao Zhang,Yijia Chen

DOI: https://doi.org/10.1109/tst.2014.6867521

2014-01-01

Abstract:Parameterized complexity is a multivariate theory for the analysis of computational problems. It leads to practically efficient algorithms for many NP-hard problems and also provides a much finer complexity classification for other intractable problems. Although the theory is mostly on decision problems, parameterized complexity naturally extends to counting problems as well. The purpose of this article is to survey a few aspects of parameterized counting complexity, with a particular emphasis on some general frameworks in which parameterized complexity proves to be indispensable.
An Isomorphism Between Subexponential and Parameterized Complexity Theory

Yijia Chen,Martin Grohe

DOI: https://doi.org/10.1137/070687153

2007-01-01

SIAM Journal on Computing

Abstract:We establish a close connection between (sub)exponential time complexity and parameterized complexity by proving that the so-called miniaturization mapping is a reduction preserving isomorphism between the two theories.
An approximation algorithm for a general class of multi-parametric optimization problems

Stephan Helfrich,Arne Herzel,Stefan Ruzika,Clemens Thielen,Helfrich, Stephan,Herzel, Arne,Ruzika, Stefan,Thielen, Clemens

DOI: https://doi.org/10.1007/s10878-022-00902-w

2022-08-30

Journal of Combinatorial Optimization

Abstract:In a widely-studied class of multi-parametric optimization problems, the objective value of each solution is an affine function of real-valued parameters. Then, the goal is to provide an optimal solution set, i.e., a set containing an optimal solution for each non-parametric problem obtained by fixing a parameter vector. For many multi-parametric optimization problems, however, an optimal solution set of minimum cardinality can contain super-polynomially many solutions. Consequently, no polynomial-time exact algorithms can exist for these problems even if $$\textsf {P}=\textsf {NP}$$ . We propose an approximation method that is applicable to a general class of multi-parametric optimization problems and outputs a set of solutions with cardinality polynomial in the instance size and the inverse of the approximation guarantee. This method lifts approximation algorithms for non-parametric optimization problems to their parametric version and provides an approximation guarantee that is arbitrarily close to the approximation guarantee of the approximation algorithm for the non-parametric problem. If the non-parametric problem can be solved exactly in polynomial time or if an FPTAS is available, our algorithm is an FPTAS. Further, we show that, for any given approximation guarantee, the minimum cardinality of an approximation set is, in general, not $$\ell $$ -approximable for any natural number $$\ell $$ less or equal to the number of parameters, and we discuss applications of our results to classical multi-parametric combinatorial optimizations problems. In particular, we obtain an FPTAS for the multi-parametric minimum s-t-cut problem, an FPTAS for the multi-parametric knapsack problem, as well as an approximation algorithm for the multi-parametric maximization of independence systems problem.

mathematics, applied,computer science, interdisciplinary applications
On Miniaturized Problems in Parameterized Complexity Theory

Yijia Chen,Jörg Flum

DOI: https://doi.org/10.1016/j.tcs.2005.10.003

IF: 1.002

2005-01-01

Theoretical Computer Science

Abstract:We introduce a general notion of miniaturization of a problem that comprises the different miniaturizations of concrete problems considered so far. We develop parts of the basic theory of miniaturizations in this general framework. Using the appropriate logical formalism, we show that the miniaturization of a definable problem in W[t] lies in W[t], too. In particular, the miniaturization of the dominating set problem is in W[2].
Approximate Evaluation of Quantitative Second Order Queries

Jan Dreier,Robert Ganian,Thekla Hamm

2023-05-03

Abstract:Courcelle's theorem and its adaptations to cliquewidth have shaped the field of exact parameterized algorithms and are widely considered the archetype of algorithmic meta-theorems. In the past decade, there has been growing interest in developing parameterized approximation algorithms for problems which are not captured by Courcelle's theorem and, in particular, are considered not fixed-parameter tractable under the associated widths. We develop a generalization of Courcelle's theorem that yields efficient approximation schemes for any problem that can be captured by an expanded logic we call Blocked CMSO, capable of making logical statements about the sizes of set variables via so-called weight comparisons. The logic controls weight comparisons via the quantifier-alternation depth of the involved variables, allowing full comparisons for zero-alternation variables and limited comparisons for one-alternation variables. We show that the developed framework threads the very needle of tractability: on one hand it can describe a broad range of approximable problems, while on the other hand we show that the restrictions of our logic cannot be relaxed under well-established complexity assumptions. The running time of our approximation scheme is polynomial in $1/\varepsilon$, allowing us to fully interpolate between faster approximate algorithms and slower exact algorithms. This provides a unified framework to explain the tractability landscape of graph problems parameterized by treewidth and cliquewidth, as well as classical non-graph problems such as Subset Sum and Knapsack.

Computational Complexity,Discrete Mathematics,Data Structures and Algorithms,Logic in Computer Science
Quantum Parameterized Complexity

Michael J. Bremner,Zhengfeng Ji,Ryan L. Mann,Luke Mathieson,Mauro E. S. Morales,Alexis T. E. Shaw

DOI: https://doi.org/10.48550/arxiv.2203.08002

2022-01-01

Abstract: Parameterized complexity theory was developed in the 1990s to enrich the complexity-theoretic analysis of problems that depend on a range of parameters. In this paper we establish a quantum equivalent of classical parameterized complexity theory, motivated by the need for new tools for the classifications of the complexity of real-world problems. We introduce the quantum analogues of a range of parameterized complexity classes and examine the relationship between these classes, their classical counterparts, and well-studied problems. This framework exposes a rich classification of the complexity of parameterized versions of QMA-hard problems, demonstrating, for example, a clear separation between the Quantum Circuit Satisfiability problem and the Local Hamiltonian problem.
Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuits

Zhan Yu,Qiuhao Chen,Yuling Jiao,Yinan Li,Xiliang Lu,Xin Wang,Jerry Zhijian Yang

2024-10-09

Abstract:Parameterized quantum circuits (PQCs) have emerged as a promising approach for quantum neural networks. However, understanding their expressive power in accomplishing machine learning tasks remains a crucial question. This paper investigates the expressivity of PQCs for approximating general multivariate function classes. Unlike previous Universal Approximation Theorems for PQCs, which are either nonconstructive or rely on parameterized classical data processing, we explicitly construct data re-uploading PQCs for approximating multivariate polynomials and smooth functions. We establish the first non-asymptotic approximation error bounds for these functions in terms of the number of qubits, quantum circuit depth, and number of trainable parameters. Notably, we demonstrate that for approximating functions that satisfy specific smoothness criteria, the quantum circuit size and number of trainable parameters of our proposed PQCs can be smaller than those of deep ReLU neural networks. We further validate the approximation capability of PQCs through numerical experiments. Our results provide a theoretical foundation for designing practical PQCs and quantum neural networks for machine learning tasks that can be implemented on near-term quantum devices, paving the way for the advancement of quantum machine learning.

Quantum Physics,Machine Learning
A Parameter Setting Heuristic for the Quantum Alternating Operator Ansatz

James Sud,Stuart Hadfield,Eleanor Rieffel,Norm Tubman,Tad Hogg

DOI: https://doi.org/10.48550/arXiv.2211.09270

2022-11-17

Abstract:Parameterized quantum circuits are widely studied approaches for tackling optimization problems. A prominent example is the Quantum Alternating Operator Ansatz (QAOA), an approach that builds off the structure of the Quantum Approximate Optimization Algorithm. Finding high-quality parameters efficiently for QAOA remains a major challenge in practice. In this work, we introduce a classical strategy for parameter setting, suitable for common cases in which the number of distinct cost values grows only polynomially with the problem size. The crux of our strategy is that we replace the cost function expectation value step of QAOA with a parameterized model that can be efficiently evaluated classically. This model is based on empirical observations that QAOA states have large overlaps with states where variable configurations with the same cost have the same amplitude, which we define as Perfect Homogeneity. We thus define a Classical Homogeneous Proxy for QAOA in which Perfect Homogeneity holds exactly, and which yields information describing both states and expectation values. We classically determine high-quality parameters for this proxy, and use these parameters in QAOA, an approach we label the Homogeneous Heuristic for Parameter Setting. We numerically examine this heuristic for MaxCut on random graphs. For up to $3$ QAOA levels we are easily able to find parameters that match approximation ratios returned by previous globally optimized approaches. For levels up to $20$ we obtain parameters with approximation ratios monotonically increasing with depth, while a strategy that uses parameter transfer instead fails to converge with comparable classical resources. These results suggest that our heuristic may find good parameters in regimes that are intractable with noisy intermediate-scale quantum devices. Finally, we outline how our heuristic may be applied to wider classes of problems.

Quantum Physics
The Parametric Cost Function Approximation: A new approach for multistage stochastic programming

Warren B Powell,Saeed Ghadimi

DOI: https://doi.org/10.48550/arXiv.2201.00258

2022-01-01

Optimization and Control

Abstract:The most common approaches for solving multistage stochastic programming problems in the research literature have been to either use value functions ("dynamic programming") or scenario trees ("stochastic programming") to approximate the impact of a decision now on the future. By contrast, common industry practice is to use a deterministic approximation of the future which is easier to understand and solve, but which is criticized for ignoring uncertainty. We show that a parameterized version of a deterministic optimization model can be an effective way of handling uncertainty without the complexity of either stochastic programming or dynamic programming. We present the idea of a parameterized deterministic optimization model, and in particular a deterministic lookahead model, as a powerful strategy for many complex stochastic decision problems. This approach can handle complex, high-dimensional state variables, and avoids the usual approximations associated with scenario trees or value function approximations. Instead, it introduces the offline challenge of designing and tuning the parameterization. We illustrate the idea by using a series of application settings, and demonstrate its use in a nonstationary energy storage problem with rolling forecasts.
A Parameterized Theory of PAC Learning

Cornelius Brand,Robert Ganian,Kirill Simonov

2023-04-27

Abstract:Probably Approximately Correct (i.e., PAC) learning is a core concept of sample complexity theory, and efficient PAC learnability is often seen as a natural counterpart to the class P in classical computational complexity. But while the nascent theory of parameterized complexity has allowed us to push beyond the P-NP ``dichotomy'' in classical computational complexity and identify the exact boundaries of tractability for numerous problems, there is no analogue in the domain of sample complexity that could push beyond efficient PAC learnability. As our core contribution, we fill this gap by developing a theory of parameterized PAC learning which allows us to shed new light on several recent PAC learning results that incorporated elements of parameterized complexity. Within the theory, we identify not one but two notions of fixed-parameter learnability that both form distinct counterparts to the class FPT -- the core concept at the center of the parameterized complexity paradigm -- and develop the machinery required to exclude fixed-parameter learnability. We then showcase the applications of this theory to identify refined boundaries of tractability for CNF and DNF learning as well as for a range of learning problems on graphs.

Computational Complexity,Artificial Intelligence
Some Lower Bounds in Parameterized AC^0.

Yijia Chen,Jorg Flum

DOI: https://doi.org/10.1016/j.ic.2019.03.008

2016-01-01

Abstract:We demonstrate some lower bounds for parameterized problems via parameterized classes corresponding to the classical AC 0. Among others, we derive such a lower bound for all fpt-approximations of the parameterized clique problem and for a parameterized halting problem, which recently turned out to link problems of computational complexity, descriptive complexity, and proof theory. To show the lower bound mentioned first we prove a strong AC 0 version of the planted clique conjecture: AC 0-circuits asymptotically almost surely can not distinguish between a random graph and this graph with a randomly planted clique of any size ≤ n ξ (where 0 ≤ ξ < 1).
Parameterized and Approximation Algorithms for Boxicity

Abhijin Adiga,Jasine Babu,L. Sunil Chandran

DOI: https://doi.org/10.48550/arXiv.1201.5958

2014-03-05

Abstract:Boxicity of a graph $G(V,$ $E)$, denoted by $box(G)$, is the minimum integer $k$ such that $G$ can be represented as the intersection graph of axis parallel boxes in $\mathbb{R}^k$. The problem of computing boxicity is inapproximable even for graph classes like bipartite, co-bipartite and split graphs within $O(n^{1 - \epsilon})$-factor, for any $\epsilon >0$ in polynomial time unless $NP=ZPP$. We give FPT approximation algorithms for computing the boxicity of graphs, where the parameter used is the vertex or edge edit distance of the given graph from families of graphs of bounded boxicity. This can be seen as a generalization of the parameterizations discussed in \cite{Adiga2}. Extending the same idea in one of our algorithms, we also get an $O\left(\frac{n\sqrt{\log \log n}}{\sqrt{\log n}}\right)$ factor approximation algorithm for computing boxicity and an $O\left(\frac{n {(\log \log n)}^{\frac{3}{2}}}{\sqrt{\log n}}\right)$ factor approximation algorithm for computing the cubicity. These seem to be the first $o(n)$ factor approximation algorithms known for both boxicity and cubicity. As a consequence of this result, a $o(n)$ factor approximation algorithm for computing the partial order dimension of finite posets and a $o(n)$ factor approximation algorithm for computing the threshold dimension of split graphs would follow.

Data Structures and Algorithms,Discrete Mathematics,Combinatorics
Approximability of Integer Programming with Generalised Constraints

Peter Jonsson,Fredrik Kuivinen,Gustav Nordh

DOI: https://doi.org/10.48550/arXiv.cs/0602047

2008-01-11

Abstract:We study a family of problems, called \prob{Maximum Solution}, where the objective is to maximise a linear goal function over the feasible integer assignments to a set of variables subject to a set of constraints. When the domain is Boolean (i.e. restricted to $\{0,1\}$), the maximum solution problem is identical to the well-studied \prob{Max Ones} problem, and the approximability is completely understood for all restrictions on the underlying constraints [Khanna et al., SIAM J. Comput., 30 (2001), pp. 1863-1920]. We continue this line of research by considering domains containing more than two elements. We present two main results: a complete classification for the approximability of all maximal constraint languages over domains of cardinality at most 4, and a complete classification of the approximability of the problem when the set of allowed constraints contains all permutation constraints. Under the assumption that a conjecture due to Szczepara holds, we give a complete classification for all maximal constraint languages. These classes of languages are well-studied in universal algebra and computer science; they have, for instance, been considered in connection with machine learning and constraint satisfaction. Our results are proved by using algebraic results from clone theory and the results indicates that this approach is very powerful for classifying the approximability of certain optimisation problems.

Computational Complexity
On Lower Bounds of Approximating Parameterized K-Clique

Bingkai Lin,Xuandi Ren,Yican Sun,Xiuhan Wang

DOI: https://doi.org/10.4230/lipics.icalp.2022.90

2021-01-01

Abstract:Given a simple graph $G$ and an integer $k$, the goal of $k$-Clique problem is to decide if $G$ contains a complete subgraph of size $k$. We say an algorithm approximates $k$-Clique within a factor $g(k)$ if it can find a clique of size at least $k / g(k)$ when $G$ is guaranteed to have a $k$-clique. Recently, it was shown that approximating $k$-Clique within a constant factor is W[1]-hard [Lin21]. We study the approximation of $k$-Clique under the Exponential Time Hypothesis (ETH). The reduction of [Lin21] already implies an $n^{\Omega(\sqrt[6]{\log k})}$-time lower bound under ETH. We improve this lower bound to $n^{\Omega(\log k)}$. Using the gap-amplification technique by expander graphs, we also prove that there is no $k^{o(1)}$ factor FPT-approximation algorithm for $k$-Clique under ETH. We also suggest a new way to prove the Parameterized Inapproximability Hypothesis (PIH) under ETH. We show that if there is no $n^{O(\frac{k}{\log k})}$ algorithm to approximate $k$-Clique within a constant factor, then PIH is true.
FPT Approximations for Packing and Covering Problems Parameterized by Elimination Distance and Even Less

Tanmay Inamdar,Lawqueen Kanesh,Madhumita Kundu,M. S. Ramanujan,Saket Saurabh

2023-10-05

Abstract:For numerous graph problems in the realm of parameterized algorithms, using the size of a smallest deletion set (called a modulator) into well-understood graph families as parameterization has led to a long and successful line of research. Recently, however, there has been an extensive study of structural parameters that are potentially much smaller than the modulator size. In particular, recent papers [Jansen et al. STOC 2021; Agrawal et al. SODA 2022] have studied parameterization by the size of the modulator to a graph family $\mathcal{H}$ ($\textbf{mod}_{\mathcal{H}}$), elimination distance to $\mathcal{H}$ ($\textbf{ed}_{\mathcal{H}}$), and $\mathcal{H}$-treewidth ($\textbf{tw}_{\mathcal{H}}$). While these new parameters have been successfully exploited to design fast exact algorithms their utility (especially that of latter two) in the context of approximation algorithms is mostly unexplored. The conceptual contribution of this paper is to present novel algorithmic meta-theorems that expand the impact of these structural parameters to the area of FPT Approximation, mirroring their utility in the design of exact FPT algorithms. Precisely, we show that if a covering or packing problem is definable in Monadic Second Order Logic and has a property called Finite Integer Index, then the existence of an FPT Approximation Scheme (FPT-AS, i.e., ($1\pm \epsilon$)-approximation) parameterized these three parameters is in fact equivalent. As concrete exemplifications of our meta-theorems, we obtain FPT-ASes for well-studied graph problems such as Vertex Cover, Feedback Vertex Set, Cycle Packing and Dominating Set, parameterized by these three parameters.

Data Structures and Algorithms
Approximation Theory and Elementary Submodels

Sean Cox

2024-06-12

Abstract:\emph{Approximation Theory} uses nicely-behaved subcategories to understand entire categories, just as projective modules are used to approximate arbitrary modules in classical homological algebra. We use set-theoretic \emph{elementary submodel arguments} to give new, short proofs of well-known theorems in approximation theory, sometimes with stronger results.

Logic,Commutative Algebra,Category Theory,Rings and Algebras
Parameterized Quantum Query Algorithms for Graph Problems

Tatsuya Terao,Ryuhei Mori

2024-08-08

Abstract:In this paper, we consider the parameterized quantum query complexity for graph problems. We design parameterized quantum query algorithms for $k$-vertex cover and $k$-matching problems, and present lower bounds on the parameterized quantum query complexity. Then, we show that our quantum query algorithms are optimal up to a constant factor when the parameters are small.

Quantum Physics,Data Structures and Algorithms

On Parameterized Approximability.

On the Optimality of Exact and Approximation Algorithms for Scheduling Problems.

Parameterized and Approximation Results for Scheduling with a Low Rank Processing Time Matrix.

Fixed-Parameter and Approximation Algorithms: A New Look

Counting Problems in Parameterized Complexity

An Isomorphism Between Subexponential and Parameterized Complexity Theory

An approximation algorithm for a general class of multi-parametric optimization problems

On Miniaturized Problems in Parameterized Complexity Theory

Approximate Evaluation of Quantitative Second Order Queries

Quantum Parameterized Complexity

Non-asymptotic Approximation Error Bounds of Parameterized Quantum Circuits

A Parameter Setting Heuristic for the Quantum Alternating Operator Ansatz

The Parametric Cost Function Approximation: A new approach for multistage stochastic programming

A Parameterized Theory of PAC Learning

Some Lower Bounds in Parameterized AC^0.

Parameterized and Approximation Algorithms for Boxicity

Approximability of Integer Programming with Generalised Constraints

On Lower Bounds of Approximating Parameterized K-Clique

FPT Approximations for Packing and Covering Problems Parameterized by Elimination Distance and Even Less

Approximation Theory and Elementary Submodels

Parameterized Quantum Query Algorithms for Graph Problems