Abstract:A range counting problem is specified by a set $P$ of size $|P| = n$ of points in $\mathbb{R}^d$, an integer weight $x_p$ associated to each point $p \in P$, and a range space ${\cal R} \subseteq 2^{P}$. Given a query range $R \in {\cal R}$, the target output is $R(\vec{x}) = \sum_{p \in R}{x_p}$. Range counting for different range spaces is a central problem in Computational Geometry. We study $(\epsilon, \delta)$-differentially private algorithms for range counting. Our main results are for the range space given by hyperplanes, that is, the halfspace counting problem. We present an $(\epsilon, \delta)$-differentially private algorithm for halfspace counting in $d$ dimensions which achieves $O(n^{1-1/d})$ average squared error. This contrasts with the $\Omega(n)$ lower bound established by the classical result of Dinur and Nissim [PODS 2003] for arbitrary subset counting queries. We also show a matching lower bound on average squared error for any $(\epsilon, \delta)$-differentially private algorithm for halfspace counting. Both bounds are obtained using discrepancy theory. For the lower bound, we use a modified discrepancy measure and bound approximation of $(\epsilon, \delta)$-differentially private algorithms for range counting queries in terms of this discrepancy. We also relate the modified discrepancy measure to classical combinatorial discrepancy, which allows us to exploit known discrepancy lower bounds. This approach also yields a lower bound of $\Omega((\log n)^{d-1})$ for $(\epsilon, \delta)$-differentially private orthogonal range counting in $d$ dimensions, the first known superconstant lower bound for this problem. For the upper bound, we use an approach inspired by partial coloring methods for proving discrepancy upper bounds, and obtain $(\epsilon, \delta)$-differentially private algorithms for range counting with polynomially bounded shatter function range spaces.

Improved Hardness Results for Learning Intersections of Halfspaces

The hardest halfspace

Efficient Algorithms for Learning Monophonic Halfspaces in Graphs

Smoothed Analysis for Learning Concepts with Low Intrinsic Dimension

Contrastive Moments: Unsupervised Halfspace Learning in Polynomial Time

Reliable Learning of Halfspaces under Gaussian Marginals

Random Separating Hyperplane Theorem and Learning Polytopes

Learning Intersections of Halfspaces with Distribution Shift: Improved Algorithms and SQ Lower Bounds

Tester-Learners for Halfspaces: Universal Algorithms

Tight Bounds for the Subspace Sketch Problem with Applications

Half-space intersection properties for minimal hypersurfaces

Hardness of Learning Boolean Functions from Label Proportions

Near-Optimal Active Learning of Halfspaces via Query Synthesis in the Noisy Setting

Fooling intersections of low-weight halfspaces

Optimal Private Halfspace Counting via Discrepancy

Computational-Statistical Gaps for Improper Learning in Sparse Linear Regression

Low-degree learning and the metric entropy of polynomials

Replicable Learning of Large-Margin Halfspaces

The Subspace Flatness Conjecture and Faster Integer Programming

Classification Under Misspecification: Halfspaces, Generalized Linear Models, and Connections to Evolvability

Non-Adaptive Stochastic Score Classification and Explainable Halfspace Evaluation