Abstract:In batch Kernel Density Estimation (KDE) for a kernel function $f$, we are given as input $2n$ points $x^{(1)}, \cdots, x^{(n)}, y^{(1)}, \cdots, y^{(n)}$ in dimension $m$, as well as a vector $v \in \mathbb{R}^n$. These inputs implicitly define the $n \times n$ kernel matrix $K$ given by $K[i,j] = f(x^{(i)}, y^{(j)})$. The goal is to compute a vector $v$ which approximates $K w$ with $|| Kw - v||_\infty < \varepsilon ||w||_1$. A recent line of work has proved fine-grained lower bounds conditioned on SETH. Backurs et al. first showed the hardness of KDE for Gaussian-like kernels with high dimension $m = \Omega(\log n)$ and large scale $B = \Omega(\log n)$. Alman et al. later developed new reductions in roughly this same parameter regime, leading to lower bounds for more general kernels, but only for very small error $\varepsilon < 2^{- \log^{\Omega(1)} (n)}$. In this paper, we refine the approach of Alman et al. to show new lower bounds in all parameter regimes, closing gaps between the known algorithms and lower bounds. In the setting where $m = C\log n$ and $B = o(\log n)$, we prove Gaussian KDE requires $n^{2-o(1)}$ time to achieve additive error $\varepsilon < \Omega(m/B)^{-m}$, matching the performance of the polynomial method up to low-order terms. In the low dimensional setting $m = o(\log n)$, we show that Gaussian KDE requires $n^{2-o(1)}$ time to achieve $\varepsilon$ such that $\log \log (\varepsilon^{-1}) > \tilde \Omega ((\log n)/m)$, matching the error bound achievable by FMM up to low-order terms. To our knowledge, no nontrivial lower bound was previously known in this regime. Our new lower bounds make use of an intricate analysis of a special case of the kernel matrix -- the `counting matrix'. As a key technical lemma, we give a novel approach to bounding the entries of its inverse by using Schur polynomials from algebraic combinatorics.

Lower Bounds for Kernelizations.

Lower Bounds for Kernelizations and Other Preprocessing Procedures

No Polynomial Kernels for Knapsack

Polynomial-time kernel reductions

Exact Parameterized Multilinear Monomial Counting via k-Layer Subset Convolution and k-Disjoint Sum.

Kernelization for Counting Problems on Graphs: Preserving the Number of Minimum Solutions

Kernelization of Counting Problems

Finer-Grained Hardness of Kernel Density Estimation

Kernelization for Orthogonality Dimension

Kernelizing Problems on Planar Graphs in Sublinear Space and Polynomial Time

On Polynomial Kernels for Sparse Integer Linear Programs

On polynomial kernelization for Stable Cutset

Lower Bounds for Higher-Order Convex Optimization

Polynomial-Time Data Reduction for Weighted Problems Beyond Additive Goal Functions

Some Lower Bounds in Parameterized AC^0.

On Lower Bounds of Approximating Parameterized K-Clique

Abstract Bergman kernel expansion and its applications

Lower Bounds for the Canonical Height of a Unicritical Polynomial and Capacity

Kernelization Dichotomies for Hitting Subgraphs under Structural Parameterizations

Bridge-Depth Characterizes which Structural Parameterizations of Vertex Cover Admit a Polynomial Kernel

A Turing Kernelization Dichotomy for Structural Parameterizations of $\mathcal{F}$-Minor-Free Deletion