On approximability of the Permanent of PSD matrices

Farzam Ebrahimnejad,Ansh Nagda,Shayan Oveis Gharan

2024-04-17

Abstract:We study the complexity of approximating the permanent of a positive semidefinite matrix $A\in \mathbb{C}^{n\times n}$.

Data Structures and Algorithms,Computational Complexity

What problem does this paper attempt to address?

A Tight Analysis of Bethe Approximation for Permanent

Nima Anari,Alireza Rezaei

DOI: https://doi.org/10.48550/arXiv.1811.02933

2019-12-10

Abstract:We prove that the permanent of nonnegative matrices can be deterministically approximated within a factor of $\sqrt{2}^n$ in polynomial time, improving upon the previous deterministic approximations. We show this by proving that the Bethe approximation of the permanent, a quantity computable in polynomial time, is at least as large as the permanent divided by $\sqrt{2}^{n}$. This resolves a conjecture of Gurvits. Our bound is tight, and when combined with previously known inequalities lower bounding the permanent, fully resolves the quality of Bethe approximation for permanent. As an additional corollary of our methods, we resolve a conjecture of Chertkov and Yedidia, proving that fractional belief propagation with fractional parameter $\gamma=-1/2$ yields an upper bound on the permanent.

Data Structures and Algorithms,Discrete Mathematics,Information Theory,Mathematical Physics,Combinatorics
A Hybrid Algorithm for Computing Permanents of Sparse Matrices

H Liang,SQ Huang,FS Bai

DOI: https://doi.org/10.1016/j.amc.2004.11.020

IF: 4.397

2006-01-01

Applied Mathematics and Computation

Abstract:The permanent of matrices has wide applications in many fields of science and engineering. It is, however, a #P-complete problem in counting. The best-known algorithm for computing the permanent, which is due to Ryser [Combinatorial Mathematics, The Carus Mathematical Monographs, vol. 14, Mathematical Association of America, Washington, DC, 1963], runs O(n2n−1) in time. It is possible to speed up algorithms for matrices with special structures, which arise commonly in applications. Most algorithms discussed before focus on 0,1 matrix. In this paper, a hybrid algorithm is proposed. It is efficient for sparse matrices.
Approximating Permanent of Random Matrices with Vanishing Mean: Made Better and Simpler

Zhengfeng Ji,Zhihan Jin,Pinyan Lu

DOI: https://doi.org/10.1137/1.9781611976465.60

2019-01-01

Abstract:The algorithm and complexity of approximating the permanent of a matrix is anextensively studied topic. Recently, its connection with quantum supremacy andmore specifically BosonSampling draws special attention to the average-caseapproximation problem of the permanent of random matrices with zero or smallmean value for each entry. Eldar and Mehraban (FOCS 2018) gave aquasi-polynomial time algorithm for random matrices with mean at least1/𝐩𝐨𝐥𝐲𝐥𝐨𝐠𝐥𝐨𝐠 (n). In this paper, we improve the result bydesigning a deterministic quasi-polynomial time algorithm and a PTAS for randommatrices with mean at least 1/𝐩𝐨𝐥𝐲𝐥𝐨𝐠(n). We note that ifit can be further improved to 1/𝐩𝐨𝐥𝐲(n), it will disprove acentral conjecture for quantum supremacy. Our algorithm is also much simpler and has a better and flexible trade-offfor running time. The running time can be quasi-polynomial in both n and1/ϵ, or PTAS (polynomial in n but exponential in 1/ϵ),where ϵ is the approximation parameter.
An upper bound for the permanent of (0,1)-matrices

Heng Liang,Fengshan Bai

DOI: https://doi.org/10.1016/j.laa.2003.09.003

IF: 1.307

2004-01-01

Linear Algebra and its Applications

Abstract:A novel upper bound for the permanent of (0,1)-matrices is obtained in this paper, by using an unbiased estimator of permanent [Random Structures Algorithms 5 (1994) 349]. It is a refinement of Minc’s very famous result, and apparently tighter than the current best general bound in some cases.
Additive estimates of the permanent using Gaussian fields

Tantrik Mukerji,Wei-Shih Yang

2024-02-14

Abstract:We present a randomized algorithm for estimating the permanent of an $M \times M$ real matrix $A$ up to an additive error. We do this by viewing the permanent $\mathrm{perm}(A)$ of $A$ as the expectation of a product of centered joint Gaussian random variables with a particular covariance matrix $C$. The algorithm outputs the empirical mean $S_{N}$ of this product after sampling $N$ times. Our algorithm runs in total time $O(M^{3} + M^{2}N + MN)$ with failure probability \begin{equation*} P(|S_{N}-\text{perm}(A)| > t) \leq \frac{3^{M}}{t^{2}N} \prod^{2M}_{i=1} C_{ii}. \end{equation*} In particular, we can estimate $\mathrm{perm}(A)$ to an additive error of $\epsilon\bigg(\sqrt{3^{2M}\prod^{2M}_{i=1} C_{ii}}\bigg)$ in polynomial time. We compare to a previous procedure due to Gurvits. We discuss how to find a particular $C$ using a semidefinite program and a relation to the Max-Cut problem and cut-norms.

Probability,Data Structures and Algorithms,Combinatorics,Quantum Physics
On the Polya permanent problem over finite fields

Gregor Dolinar,Alexander E. Guterman,Bojan Kuzma,Marko Orel

DOI: https://doi.org/10.48550/arXiv.1003.1984

2010-03-10

Abstract:Let $\FF$ be a finite field of characteristics different from two. We show that no bijective map transforms permanent into determinant when the cardinality of $\FF$ is sufficiently large. We also give an example of non-bijective map when $\FF$ is arbitrary and an example of a bijective map when $\FF$ is infinite which do transform permanent into determinant. The developed technique allows us to estimate the probability of the permanent and the determinant of matrices over finite fields to have a given value. Our results are also true over finite rings without zero divisors.

Combinatorics
Robust and Sample Optimal Algorithms for PSD Low-Rank Approximation

Ainesh Bakshi,Nadiia Chepurko,David P. Woodruff

DOI: https://doi.org/10.48550/arXiv.1912.04177

2021-06-16

Abstract:Recently, Musco and Woodruff (FOCS, 2017) showed that given an $n \times n$ positive semidefinite (PSD) matrix $A$, it is possible to compute a $(1+\epsilon)$-approximate relative-error low-rank approximation to $A$ by querying $O(nk/\epsilon^{2.5})$ entries of $A$ in time $O(nk/\epsilon^{2.5} +n k^{\omega-1}/\epsilon^{2(\omega-1)})$. They also showed that any relative-error low-rank approximation algorithm must query $\Omega(nk/\epsilon)$ entries of $A$, this gap has since remained open. Our main result is to resolve this question by obtaining an optimal algorithm that queries $O(nk/\epsilon)$ entries of $A$ and outputs a relative-error low-rank approximation in $O(n(k/\epsilon)^{\omega-1})$ time. Note, our running time improves that of Musco and Woodruff, and matches the information-theoretic lower bound if the matrix-multiplication exponent $\omega$ is $2$. We then extend our techniques to negative-type distance matrices. Bakshi and Woodruff (NeurIPS, 2018) showed a bi-criteria, relative-error low-rank approximation which queries $O(nk/\epsilon^{2.5})$ entries and outputs a rank-$(k+4)$ matrix. We show that the bi-criteria guarantee is not necessary and obtain an $O(nk/\epsilon)$ query algorithm, which is optimal. Our algorithm applies to all distance matrices that arise from metrics satisfying negative-type inequalities, including $\ell_1, \ell_2,$ spherical metrics and hypermetrics. Next, we introduce a new robust low-rank approximation model which captures PSD matrices that have been corrupted with noise. While a sample complexity lower bound precludes sublinear algorithms for arbitrary PSD matrices, we provide the first sublinear time and query algorithms when the corruption on the diagonal entries is bounded. As a special case, we show sample-optimal sublinear time algorithms for low-rank approximation of correlation matrices corrupted by noise.

Data Structures and Algorithms,Machine Learning
On generators of $k$-PSD closures of the positive semidefinite cone

Avinash Bhardwaj,Vishnu Narayanan,Abhishek Pathapati

2024-05-02

Abstract:Positive semidefinite (PSD) cone is the cone of positive semidefinite matrices, and is the object of interest in semidefinite programming (SDP). A computational efficient approximation of the PSD cone is the $k$-PSD closure, $1 \leq k < n$, cone of $n\times n$ real symmetric matrices such that all of their $k\times k$ principal submatrices are positive semidefinite. For $k=1$, one obtains a polyhedral approximation, while $k=2$ yields a second order conic (SOC) approximation of the PSD cone. These approximations of the PSD cone have been used extensively in real-world applications such as AC Optimal Power Flow (ACOPF) to address computational inefficiencies where SDP relaxations are utilized for convexification the non-convexities. However a theoretical discussion about the geometry of these conic approximations of the PSD cone is rather sparse. In this short communication, we attempt to provide a characterization of some family of generators of the aforementioned conic approximations.

Optimization and Control
Some upper and lower bounds on PSD-rank

Troy Lee,Zhaohui Wei,Ronald de Wolf

DOI: https://doi.org/10.1007/s10107-016-1052-0

IF: 2.7

2016-07-16

Mathematical Programming

Abstract:Positive semidefinite rank (PSD-rank) is a relatively new complexity measure on matrices, with applications to combinatorial optimization and communication complexity. We first study several basic properties of PSD-rank, and then develop new techniques for showing lower bounds on the PSD-rank. All of these bounds are based on viewing a positive semidefinite factorization of a matrix M as a quantum communication protocol. These lower bounds depend on the entries of the matrix and not only on its support (the zero/nonzero pattern), overcoming a limitation of some previous techniques. We compare these new lower bounds with known bounds, and give examples where the new ones are better. As an application we determine the PSD-rank of (approximations of) some common matrices.

mathematics, applied,computer science, software engineering,operations research & management science
Approximate Completely Positive Semidefinite Factorizations and their Ranks

Paria Abbasi,Andreas Klingler,Tim Netzer

DOI: https://doi.org/10.1016/j.laa.2023.08.005

2023-09-04

Abstract:In this paper we show the existence of approximate completely positive semidefinite (cpsd) factorizations with a cpsd-rank bounded above (almost) independently from the cpsd-rank of the initial matrix. This is particularly relevant since the cpsd-rank of a matrix cannot, in general, be upper bounded by a function only depending on its size. For this purpose, we make use of the Approximate Caratheodory Theorem in order to construct an approximate matrix with a low-rank Gram representation. We then employ the Johnson-Lindenstrauss Lemma to improve to a logarithmic dependence of the cpsd-rank on the size.

Algebraic Geometry
Permanental inequalities for totally positive matrices

Mark Skandera,Daniel Soskin

2024-06-03

Abstract:We characterize ratios of permanents of (generalized) submatrices which are bounded on the set of all totally positive matrices. This provides a permanental analog of results of Fallat, Gekhtman, and Johnson [{\em Adv.\ Appl.\ Math.} {\bf 30} no.\ 3, (2003) pp.\ 442--470] concerning ratios of matrix minors. We also extend work of Drake, Gerrish, and the first author [{\em Electron.\ J.\ Combin.,} {\bf 11} no.\ 1, (2004) Note 6] by characterizing the differences of monomials in $\mathbb{Z}[x_{1,1},x_{1,2},...,x_{n,n}]$ which evaluate positively on the set of all totally positive $n \times n$ matrices.

Combinatorics
Testing Positive Semidefiniteness Using Linear Measurements

Deanna Needell,William Swartworth,David P. Woodruff

2023-10-25

Abstract:We study the problem of testing whether a symmetric $d \times d$ input matrix $A$ is symmetric positive semidefinite (PSD), or is $\epsilon$-far from the PSD cone, meaning that $\lambda_{\min}(A) \leq - \epsilon \|A\|_p$, where $\|A\|_p$ is the Schatten-$p$ norm of $A$. In applications one often needs to quickly tell if an input matrix is PSD, and a small distance from the PSD cone may be tolerable. We consider two well-studied query models for measuring efficiency, namely, the matrix-vector and vector-matrix-vector query models. We first consider one-sided testers, which are testers that correctly classify any PSD input, but may fail on a non-PSD input with a tiny failure probability. Up to logarithmic factors, in the matrix-vector query model we show a tight $\widetilde{\Theta}(1/\epsilon^{p/(2p+1)})$ bound, while in the vector-matrix-vector query model we show a tight $\widetilde{\Theta}(d^{1-1/p}/\epsilon)$ bound, for every $p \geq 1$. We also show a strong separation between one-sided and two-sided testers in the vector-matrix-vector model, where a two-sided tester can fail on both PSD and non-PSD inputs with a tiny failure probability. In particular, for the important case of the Frobenius norm, we show that any one-sided tester requires $\widetilde{\Omega}(\sqrt{d}/\epsilon)$ queries. However we introduce a bilinear sketch for two-sided testing from which we construct a Frobenius norm tester achieving the optimal $\widetilde{O}(1/\epsilon^2)$ queries. We also give a number of additional separations between adaptive and non-adaptive testers. Our techniques have implications beyond testing, providing new methods to approximate the spectrum of a matrix with Frobenius norm error using dimensionality reduction in a way that preserves the signs of eigenvalues.

Data Structures and Algorithms,Numerical Analysis
Upper bounds on the permanent of multidimensional (0,1)-matrices

A. A. Taranenko

DOI: https://doi.org/10.48550/arXiv.1412.1933

2014-12-05

Abstract:The permanent of a multidimensional matrix is the sum of products of entries over all diagonals. By Minc's conjecture, there exists a reachable upper bound on the permanent of 2-dimensional (0,1)-matrices. In this paper we obtain some generalizations of Minc's conjecture to the multidimensional case. For this purpose we prove and compare several bounds on the permanent of multidimensional (0,1)-matrices. Most estimates can be used for matrices with nonnegative bounded entries.

Combinatorics
On Some Determinants and Permanents

Zhi‐Wei Sun

DOI: https://doi.org/10.48550/arxiv.2207.13039

2022-01-01

Abstract:In this paper we study some determinants and permanents. In particular, we investigate the new type determinants $$\det[(i^2+cij+dj^2)^{p-2}]_{1\le i,j\le p-1}\ \text{and} \ \det[(i^2+cij+dj^2)^{p-2}]_{0\le i,j\le p-1}$$ modulo an odd prime $p$, where $c$ and $d$ are integers. We also pose some conjectures for further research.
A Semidefinite Relaxation Algorithm for Checking Completely Positive Separable Matrices

Anwa Zhou,Jinyan Fan

DOI: https://doi.org/10.3934/jimo.2018076

2019-01-01

Journal of Industrial and Management Optimization

Abstract:A symmetric matrix A is completely positive (CP) if there exists an entrywise nonnegative matrix V such that A = VVT. A real symmetric matrix is called completely positive separable (CPS) if it can be written as a sum of rank-1 Kronecker products of completely positive matrices. This paper studies the CPS problem. A criterion is given to determine whether a given matrix is CPS, and a specific CPS decomposition is constructed if the matrix is CPS.
Degree-$M$ Bethe and Sinkhorn Permanent Based Bounds on the Permanent of a Non-negative Matrix

Yuwen Huang,Navin Kashyap,Pascal O. Vontobel

2024-05-28

Abstract:The permanent of a non-negative square matrix can be well approximated by finding the minimum of the Bethe free energy functions associated with some suitably defined factor graph; the resulting approximation to the permanent is called the Bethe permanent. Vontobel gave a combinatorial characterization of the Bethe permanent via degree-$M$ Bethe permanents, which are based on degree-$M$ covers of the underlying factor graph. In this paper, we prove a degree-$M$-Bethe-permanent-based lower bound on the permanent of a non-negative matrix, which solves a conjecture proposed by Vontobel in [IEEE Trans. Inf. Theory, Mar. 2013]. We also prove a degree-$M$-Bethe-permanent-based upper bound on the permanent of a non-negative matrix. In the limit $M \to \infty$, these lower and upper bounds yield known Bethe-permanent-based lower and upper bounds on the permanent of a non-negative matrix. Moreover, we prove similar results for an approximation to the permanent known as the (scaled) Sinkhorn permanent.

Combinatorics,Information Theory
Some Properties for the Euclidean Distance Matrix and Positive Semidefinite Matrix Completion Problems

Hong-Xuan Huang,Zhi-An Liang,Panos M. Pardalos

DOI: https://doi.org/10.1023/A:1021336413386

2003-01-01

Journal of Global Optimization

Abstract:The Euclidean distance matrix (EDM) completion problem and the positive semidefinite (PSD) matrix completion problem are considered in this paper. Approaches to determine the location of a point in a linear manifold are studied, which are based on a referential coordinate set and a distance vector whose components indicate the distances from the point to other points in the set. For a given referential coordinate set and a corresponding distance vector, sufficient and necessary conditions are presented for the existence of such a point that the distance vector can be realized. The location of the point (if it exists) given by the approaches in a linear manifold is independent of the coordinate system, and is only related to the referential coordinate set and the corresponding distance vector. An interesting phenomenon about the complexity of the EDM completion problem is described. Some properties about the uniqueness and the rigidity of the conformation for solutions to the EDM and PSD completion problems are presented.
A p-adic Perron-Frobenius Theorem

Robert Costa,Patrick Dynes,Clayton Petsche

DOI: https://doi.org/10.48550/arXiv.1509.01702

2016-04-08

Abstract:We prove that if an $n\times n$ matrix defined over ${\mathbb Q}_p$ (or more generally an arbitrary complete, discretely-valued, non-Archimedean field) satisfies a certain congruence property, then it has a strictly maximal eigenvalue in ${\mathbb Q}_p$, and that iteration of the (normalized) matrix converges to a projection operator onto the corresponding eigenspace. This result may be viewed as a $p$-adic analogue of the Perron-Frobenius theorem for positive real matrices.

Number Theory,Dynamical Systems
On the codimension of permanental varieties

Ada Boralevi,Enrico Carlini,Mateusz Michałek,Emanuele Ventura

2024-02-28

Abstract:In this article, we study permanental varieties, i.e. varieties defined by the vanishing of permanents of fixed size of a generic matrix. Permanents and their varieties play an important, and sometimes poorly understood, role in combinatorics. However, there are essentially no geometric results about them in the literature, in very sharp contrast to the well-behaved and ubiquitous case of determinants and minors. Motivated by the study of the singular locus of the permanental hypersurface, we focus on the codimension of these varieties. We introduce a $\mathbb C^{*}$-action on matrices and prove a number of results. In particular, we improve a lower bound on the codimension of the aforementioned singular locus established by von zur Gathen in 1987.

Combinatorics,Algebraic Geometry
Approximate Projections onto the Positive Semidefinite Cone Using Randomization

Morgan Jones,James Anderson

2024-10-25

Abstract:This paper presents two novel algorithms for approximately projecting symmetric matrices onto the Positive Semidefinite (PSD) cone using Randomized Numerical Linear Algebra (RNLA). Classical PSD projection methods rely on full-rank deterministic eigen-decomposition, which can be computationally prohibitive for large-scale problems. Our approach leverages RNLA to construct low-rank matrix approximations before projection, significantly reducing the required numerical resources. The first algorithm utilizes random sampling to generate a low-rank approximation, followed by a standard eigen-decomposition on this smaller matrix. The second algorithm enhances this process by introducing a scaling approach that aligns the leading-order singular values with the positive eigenvalues, ensuring that the low-rank approximation captures the essential information about the positive eigenvalues for PSD projection. Both methods offer a trade-off between accuracy and computational speed, supported by probabilistic error bounds. To further demonstrate the practical benefits of our approach, we integrate the randomized projection methods into a first-order Semi-Definite Programming (SDP) solver. Numerical experiments, including those on SDPs derived from Sum-of-Squares (SOS) programming problems, validate the effectiveness of our method, especially for problems that are infeasible with traditional deterministic methods.

Optimization and Control,Numerical Analysis

On approximability of the Permanent of PSD matrices

A Tight Analysis of Bethe Approximation for Permanent

A Hybrid Algorithm for Computing Permanents of Sparse Matrices

Approximating Permanent of Random Matrices with Vanishing Mean: Made Better and Simpler

An upper bound for the permanent of (0,1)-matrices

Additive estimates of the permanent using Gaussian fields

On the Polya permanent problem over finite fields

Robust and Sample Optimal Algorithms for PSD Low-Rank Approximation

On generators of $k$-PSD closures of the positive semidefinite cone

Some upper and lower bounds on PSD-rank

Approximate Completely Positive Semidefinite Factorizations and their Ranks

Permanental inequalities for totally positive matrices

Testing Positive Semidefiniteness Using Linear Measurements

Upper bounds on the permanent of multidimensional (0,1)-matrices

On Some Determinants and Permanents

A Semidefinite Relaxation Algorithm for Checking Completely Positive Separable Matrices

Degree-$M$ Bethe and Sinkhorn Permanent Based Bounds on the Permanent of a Non-negative Matrix

Some Properties for the Euclidean Distance Matrix and Positive Semidefinite Matrix Completion Problems

A p-adic Perron-Frobenius Theorem

On the codimension of permanental varieties

Approximate Projections onto the Positive Semidefinite Cone Using Randomization