Maximum mean discrepancies of Farey sequences

Toni Karvonen,Anatoly Zhigljavsky

2024-08-05

Abstract:We identify a large class of positive-semidefinite kernels for which a certain polynomial rate of convergence of maximum mean discrepancies of Farey sequences is equivalent to the Riemann hypothesis. This class includes all Matérn kernels of order at least one-half.

Statistics Theory,Number Theory,Machine Learning

What problem does this paper attempt to address?

The Proof of Kazhdan-Mazur's Nonvanishing Hypothesis

Binyong Sun

DOI: https://doi.org/10.3969/j.issn.1673-8128.2018.01.024

2018-01-01

Abstract:We prove the nonvanishing hypothesis at infinity for Rankin-Selberg convolutions for GL(n)× GL(n-1).
Targeted Separation and Convergence with Kernel Discrepancies

Alessandro Barp,Carl-Johann Simon-Gabriel,Mark Girolami,Lester Mackey

2024-10-22

Abstract:Maximum mean discrepancies (MMDs) like the kernel Stein discrepancy (KSD) have grown central to a wide range of applications, including hypothesis testing, sampler selection, distribution approximation, and variational inference. In each setting, these kernel-based discrepancy measures are required to (i) separate a target P from other probability measures or even (ii) control weak convergence to P. In this article we derive new sufficient and necessary conditions to ensure (i) and (ii). For MMDs on separable metric spaces, we characterize those kernels that separate Bochner embeddable measures and introduce simple conditions for separating all measures with unbounded kernels and for controlling convergence with bounded kernels. We use these results on $\mathbb{R}^d$ to substantially broaden the known conditions for KSD separation and convergence control and to develop the first KSDs known to exactly metrize weak convergence to P. Along the way, we highlight the implications of our results for hypothesis testing, measuring and improving sample quality, and sampling with Stein variational gradient descent.

Machine Learning,Statistics Theory
Inequality and Nyman-Beurling-Baez-Duarte criteria

Kwok Kwan Wong

2023-11-08

Abstract:We proposed a proof of the Riemann hypothesis. The proof is based on the Nyman-Beurling-Baez-Duarte condition. By proving existence of the solution for a system of inequalities, we can show that there is a sequence, which act as the coefficient of Beurling's sequence, can approximate the constant vector in a weighted Hilbert space.

General Mathematics
An empirical approach for probing the definiteness of kernels

Martin Zaefferer,Thomas Bartz-Beielstein,Günter Rudolph

DOI: https://doi.org/10.1007/s00500-018-3648-1

IF: 3.732

2018-11-26

Soft Computing

Abstract:Models like support vector machines or Gaussian process regression often require positive semi-definite kernels. These kernels may be based on distance functions. While definiteness is proven for common distances and kernels, a proof for a new kernel may require too much time and effort for users who simply aim at practical usage. Furthermore, designing definite distances or kernels may be equally intricate. Finally, models can be enabled to use indefinite kernels. This may deteriorate the accuracy or computational cost of the model. Hence, an efficient method to determine definiteness is required. We propose an empirical approach. We show that sampling as well as optimization with an evolutionary algorithm may be employed to determine definiteness. We provide a proof of concept with 16 different distance measures for permutations. Our approach allows to disprove definiteness if a respective counterexample is found. It can also provide an estimate of how likely it is to obtain indefinite kernel matrices. This provides a simple, efficient tool to decide whether additional effort should be spent on designing/selecting a more suitable kernel or algorithm.

computer science, artificial intelligence, interdisciplinary applications
Generalized Fejér monotone sequences and their finitary content

Nicholas Pischke

DOI: https://doi.org/10.1080/02331934.2024.2390114

IF: 2.2

2024-08-18

Optimization

Abstract:We provide quantitative and abstract strong convergence results for sequences from a compact metric space satisfying a certain form of generalized Fejér monotonicity where (1) the metric can be replaced by a much more general type of function measuring distances (including, in particular, certain Bregman distances), (2) full Fejér monotonicity is relaxed to a partial variant and (3) the distance functions are allowed to vary along the iteration. For such sequences, the paper provides explicit and effective rates of metastability and even rates of convergence, the latter under a regularity assumption that generalizes the notion of metric regularity introduced by Kohlenbach, López-Acedo and Nicolae, itself an abstract generalization of many regularity notions from the literature. In the second part of the paper, we apply the abstract quantitative results established in the first part to two algorithms: one algorithm for approximating zeros of maximally monotone and maximally ρ -comonotone operators in Hilbert spaces (in the sense of Combettes and Pennanen as well as Bauschke, Moursi and Wang) that incorporates inertia terms every other term and another algorithm for approximating zeros of monotone operators in Banach spaces (in the sense of Browder) that is only Fejér monotone w.r.t. a certain Bregman distance.

mathematics, applied,operations research & management science
Positive Definite Kernels and Random Sequences Connected to Polynomial Hypergroups

Volker Hösel

2024-11-26

Abstract:This work explores new classes of nonstationary stochastic sequences associated with polynomial hypergroups. Their covariance structures are analyzed through positive definite kernels and corresponding Hilbert spaces. Novel consistent estimators are introduced for deriving covariance structures from sequence realizations. A comprehensive prediction theory is developed, including a fast Levinson-type algorithm for efficiently calculating best linear predictors. Wiener-type theorems are established, enabling the detection of spectral measure atoms via generalized periodograms. Additional advancements, such as prediction with supplementary information, further enhance the scope of this study.

Functional Analysis,Statistics Theory
Maximum interpoint distance of high-dimensional random vectors

Johannes Heiny,Carolin Kleemann

2024-02-12

Abstract:A limit theorem for the largest interpoint distance of $p$ independent and identically distributed points in $\mathbb{R}^n$ to the Gumbel distribution is proved, where the number of points $p=p_n$ tends to infinity as the dimension of the points $n\to\infty$. The theorem holds under moment assumptions and corresponding conditions on the growth rate of $p$. We obtain a plethora of ancillary results such as the joint convergence of maximum and minimum interpoint distances. Using the inherent sum structure of interpoint distances, our result is generalized to maxima of dependent random walks with non-decaying correlations and we also derive point process convergence. An application of the maximum interpoint distance to testing the equality of means for high-dimensional random vectors is presented. Moreover, we study the largest off-diagonal entry of a sample covariance matrix. The proofs are based on the Chen-Stein Poisson approximation method and Gaussian approximation to large deviation probabilities.

Probability,Statistics Theory
Minimum Kernel Discrepancy Estimators

Chris. J. Oates

2023-08-23

Abstract:For two decades, reproducing kernels and their associated discrepancies have facilitated elegant theoretical analyses in the setting of quasi Monte Carlo. These same tools are now receiving interest in statistics and related fields, as criteria that can be used to select an appropriate statistical model for a given dataset. The focus of this article is on minimum kernel discrepancy estimators, whose use in statistical applications is reviewed, and a general theoretical framework for establishing their asymptotic properties is presented.

Methodology,Statistics Theory
Unbalanced Optimal Transport and Maximum Mean Discrepancies: Interconnections and Rapid Evaluation

Rajmadan Lakshmanan,Alois Pichler

2024-05-14

Abstract:This contribution presents substantial computational advancements to compare measures even with varying masses. Specifically, we utilize the nonequispaced fast Fourier transform to accelerate the radial kernel convolution in unbalanced optimal transport approximation, built upon the Sinkhorn algorithm. We also present accelerated schemes for maximum mean discrepancies involving kernels. Our approaches reduce the arithmetic operations needed to compute distances from $\mathcal O(n^2)$ to $\mathcal O(n\log n)$, opening the door to handle large and high-dimensional datasets efficiently. Furthermore, we establish robust connections between transportation problems, encompassing Wasserstein distance and unbalanced optimal transport, and maximum mean discrepancies. This empowers practitioners with compelling rationale to opt for adaptable distances.

Optimization and Control
On The Relative Error of Random Fourier Features for Preserving Kernel Distance

Kuan Cheng,Shaofeng H. -C. Jiang,Luojian Wei,Zhide Wei

DOI: https://doi.org/10.48550/arxiv.2210.00244

2022-01-01

Abstract: The method of random Fourier features (RFF), proposed in a seminal paper by Rahimi and Recht (NIPS'07), is a powerful technique to find approximate low-dimensional representations of points in (high-dimensional) kernel space, for shift-invariant kernels. While RFF has been analyzed under various notions of error guarantee, the ability to preserve the kernel distance with \emph{relative} error is less understood. We show that for a significant range of kernels, including the well-known Laplacian kernels, RFF cannot approximate the kernel distance with small relative error using low dimensions. We complement this by showing as long as the shift-invariant kernel is analytic, RFF with $\mathrm{poly}(\epsilon^{-1} \log n)$ dimensions achieves $\epsilon$-relative error for pairwise kernel distance of $n$ points, and the dimension bound is improved to $\mathrm{poly}(\epsilon^{-1}\log k)$ for the specific application of kernel $k$-means. Finally, going beyond RFF, we make the first step towards data-oblivious dimension-reduction for general shift-invariant kernels, and we obtain a similar $\mathrm{poly}(\epsilon^{-1} \log n)$ dimension bound for Laplacian kernels. We also validate the dimension-error tradeoff of our methods on simulated datasets, and they demonstrate superior performance compared with other popular methods including random-projection and Nystr\"{o}m methods.
Discretized Keiper/Li Approach to the Riemann Hypothesis

André Voros

DOI: https://doi.org/10.1080/10586458.2018.1482480

2018-07-17

Experimental Mathematics

Abstract:The Keiper–Li sequence {λn} is most sensitive to the Riemann Hypothesis asymptotically (n → ∞), but highly elusive both analytically and numerically. We deform it to fully explicit sequences, simpler to analyze and to compute (up to n = 5 · 105 by G. Misguich). This also works on the Davenport–Heilbronn counterexamples, thus we can demonstrate explicit tests that selectively react to zeros off the critical line.

mathematics
Smallest denominators

Jens Marklof

DOI: https://doi.org/10.1112/blms.13034

IF: 1.036

2024-03-28

Bulletin of the London Mathematical Society

Abstract:We establish higher dimensional versions of a recent theorem by Chen and Haynes [Int. J. Number Theory 19 (2023), 1405–1413] on the expected value of the smallest denominator of rational points in a randomly shifted interval of small length, and of the closely related 1977 Kruyswijk–Meijer conjecture recently proved by Balazard and Martin [Bull. Sci. Math. 187 (2023), Paper No. 103305]. We express the distribution of smallest denominators in terms of the void statistics of multidimensional Farey fractions and prove convergence of the distribution function and certain finite moments. The latter was previously unknown even in the one‐dimensional setting. We furthermore obtain a higher dimensional extension of Kargaev and Zhigljavsky's work on moments of the distance function for the Farey sequence [J. Number Theory 65 (1997), 130–149] as well as new results on pigeonhole statistics.

mathematics
Gaps in the complex Farey sequence of an imaginary quadratic number field

Rafael Sayous

2024-07-05

Abstract:Given an imaginary quadratic number field $K$ with ring of integers $\mathcal{O}_K$, we are interested in the asymptotic \emph{distance to nearest neighbour} (or \emph{gap}) statistic of complex Farey fractions $\frac{p}{q}$, with $p,q \in \mathcal{O}_K$ and $0<|q|\leq T$, as $T \to \infty$. Reformulating this problem in a homogeneous dynamical setting, we follow the approach of J. Marklof for real Farey fractions with several variables (2013) and adapt a joint equidistribution result in the real $3$-dimensional hyperbolic space of J. Parkkonen and F. Paulin (2023) to derive the existence of a probability measure describing this asymptotic gap statistic. We obtain an integral formula for the associated cumulative distribution function, and use geometric arguments to find an explicit estimate for its tail distribution in the cases of Gaussian and Eisenstein fractions.

Number Theory,Dynamical Systems
A Pólya criterion for (strict) positive definiteness on the sphere

R.K. Beatson,W. zu Castell,Y. Xu

DOI: https://doi.org/10.48550/arXiv.1110.2437

2011-10-12

Abstract:Positive definite functions are very important in both theory and applications of approximation theory, probability and statistics. In particular, identifying strictly positive definite kernels is of great interest as interpolation problems corresponding to these kernels are guaranteed to be poised. A Bochner type result of Schoenberg characterises continuous positive definite zonal functions, $f(\cos \cdot)$, on the sphere $\Sdmone$, as those with nonnegative Gegenbauer coefficients. More recent results characterise strictly positive definite functions on $\Sdmone$ by stronger conditions on the signs of the Gegenbauer coefficients. Unfortunately, given a function $f$, checking the signs of all the Gegenbauer coefficients can be an onerous, or impossible, task. Therefore, it is natural to seek simpler sufficient conditions which guarantee (strict) positive definiteness. We state a conjecture which leads to a Pólya type criterion for functions to be (strictly) positive definite on the sphere $\Sdmone$. In analogy to the case of the Euclidean space, the conjecture claims positivity of a certain integral involving Gegenbauer polynomials. We provide a proof of the conjecture for $d$ from 3 to 8.

Classical Analysis and ODEs
Average-case matrix discrepancy: satisfiability bounds

Antoine Maillard

2024-10-23

Abstract:Given a sequence of $d \times d$ symmetric matrices $\{\mathbf{W}_i\}_{i=1}^n$, and a margin $\Delta > 0$, we investigate whether it is possible to find signs $(\epsilon_1, \dots, \epsilon_n) \in \{\pm 1\}^n$ such that the operator norm of the signed sum satisfies $\|\sum_{i=1}^n \epsilon_i \mathbf{W}_i\|_\mathrm{op} \leq \Delta$. Kunisky and Zhang (2023) recently introduced a random version of this problem, where the matrices $\{\mathbf{W}_i\}_{i=1}^n$ are drawn from the Gaussian orthogonal ensemble. This model can be seen as a random variant of the celebrated Matrix Spencer conjecture and as a matrix-valued analog of the symmetric binary perceptron in statistical physics. In this work, we establish a satisfiability transition in this problem as $n, d \to \infty$ with $n / d^2 \to \tau > 0$. Our contributions are twofold. First, we prove that the expected number of solutions with margin $\Delta=\kappa \sqrt{n}$ has a sharp threshold at a critical $\tau_1(\kappa)$: for $\tau < \tau_1(\kappa)$ the problem is typically unsatisfiable, while for $\tau > \tau_1(\kappa)$ the average number of solutions becomes exponentially large. Second, combining a second-moment method with recent results from Altschuler (2023) on margin concentration in perceptron-type problems, we identify a second threshold $\tau_2(\kappa)$, such that for $\tau>\tau_2(\kappa)$ the problem admits solutions with high probability. In particular, we establish for the first time that a system of $n = \Theta(d^2)$ Gaussian random matrices can be balanced so that the spectrum of the resulting matrix macroscopically shrinks compared to the typical semicircle law. Our proofs rely on deriving concentration inequalities and large deviation properties for the law of correlated Gaussian matrices under spectral norm constraints, extending results in the literature and offering insights of independent interest.

Probability,Disordered Systems and Neural Networks,Discrete Mathematics,Combinatorics
The Duffin–Schaeffer conjecture for systems of linear forms

Felipe A. Ramírez

DOI: https://doi.org/10.1112/jlms.12909

2024-05-02

Journal of the London Mathematical Society

Abstract:We extend the Duffin–Schaeffer conjecture to the setting of systems of m linear forms in n variables. That is, we establish a criterion to determine whether, for a given rate of approximation, almost all or almost no n ‐by‐m systems of linear forms are approximable at that rate using integer vectors satisfying a natural coprimality condition. When m=n=1 , this is the classical 1941 Duffin–Schaeffer conjecture, which was proved in 2020 by Koukoulopoulos and Maynard. Pollington and Vaughan proved the higher dimensional version, where m>1 and n=1 , in 1990. The general statement we prove here was conjectured in 2009 by Beresnevich, Bernik, Dodson, and Velani. For approximations with no coprimality requirement, they also conjectured a generalized version of Catlin's conjecture, and in 2010, Beresnevich and Velani proved the m>1 cases of that. Catlin's classical conjecture, where m=n=1 , follows from the classical Duffin–Schaeffer conjecture. The remaining cases of the generalized version, where m=1 and n>1 , follow from our main result. Finally, through the mass transference principle, our main results imply their Hausdorff measure analogues, which were also conjectured by Beresnevich et al.

mathematics
Fourier-Dedekind Sums and an Extension of Rademacher Reciprocity

Emmanuel Tsukerman

DOI: https://doi.org/10.48550/arXiv.1307.5542

2013-10-04

Abstract:Fourier-Dedekind sums are a generalization of Dedekind sums - important number-theoretical objects that arise in many areas of mathematics, including lattice point enumeration, signature defects of manifolds and pseudo random number generators. A remarkable feature of Fourier-Dedekind sums is that they satisfy a reciprocity law called Rademacher reciprocity. In this paper, we study several aspects of Fourier-Dedekind sums: properties of general Fourier-Dedekind sums, extensions of the reciprocity law, average behavior of Fourier-Dedekind sums, and finally, extrema of 2-dimensional Fourier-Dedekind sums. On properties of general Fourier-Dedekind sums we show that a general Fourier-Dedekind sum is simultaneously a convolution of simpler Fourier-Dedekind sums, and a linear combination of these with integer coefficients. We show that Fourier-Dedekind sums can be extended naturally to a group under convolution. We introduce "Reduced Fourier-Dedekind sums", which encapsulate the complexity of a Fourier-Dedekind sum, describe these in terms of generating functions, and give a geometric interpretation. Next, by finding interrelations among Fourier-Dedekind sums, we extend the range on which Rademacher reciprocity Theorem holds. We go on to study the average behavior of Fourier-Dedekind sums, showing that the average behavior of a Fourier-Dedekind sum is described concisely by a lower-dimensional, simpler Fourier-Dedekind sum. Finally, we focus our study on 2-dimensional Fourier-Dedekind sums. We find tight upper and lower bounds on these for a fixed $t$, estimates on the argmax and argmin, and bounds on the sum of their "reciprocals".

Number Theory,Combinatorics

Maximum mean discrepancies of Farey sequences

The Proof of Kazhdan-Mazur's Nonvanishing Hypothesis

Targeted Separation and Convergence with Kernel Discrepancies

Inequality and Nyman-Beurling-Baez-Duarte criteria

An empirical approach for probing the definiteness of kernels

Generalized Fejér monotone sequences and their finitary content

Positive Definite Kernels and Random Sequences Connected to Polynomial Hypergroups

Maximum interpoint distance of high-dimensional random vectors

Minimum Kernel Discrepancy Estimators

Unbalanced Optimal Transport and Maximum Mean Discrepancies: Interconnections and Rapid Evaluation

On The Relative Error of Random Fourier Features for Preserving Kernel Distance

Discretized Keiper/Li Approach to the Riemann Hypothesis

Smallest denominators

Gaps in the complex Farey sequence of an imaginary quadratic number field

A Pólya criterion for (strict) positive definiteness on the sphere

Average-case matrix discrepancy: satisfiability bounds

The Duffin–Schaeffer conjecture for systems of linear forms

Fourier-Dedekind Sums and an Extension of Rademacher Reciprocity