Abstract:We consider the approximate nearest neighbor search problem on the Hamming cube $\{0,1\}^d$. We show that a randomized cell probe algorithm that uses polynomial storage and word size $d^{O(1)}$ requires a worst case query time of $\Omega({\rm log}\,{\rm log}\,d/{\rm log}\,{\rm log}\,{\rm log}\,d)$. The approximation factor may be as loose as $2^{{\rm log}^{1-\eta}d}$ for any fixed $\eta>0$. Our result fills a major gap in the study of this problem since all earlier lower bounds either did not allow randomization [A. Chakrabarti et al., A lower bound on the complexity of approximate nearest-neighbor searching on the Hamming cube, in Discrete and Computational Geometry, Springer, Berlin, 2003, pp. 313328; D. Liu, Inform. Process. Lett., 92 (2004), pp. 2329] or did not allow approximation [A. Borodin, R. Ostrovsky, and Y. Rabani, Proceedings of the 31st Annual ACM Symposium on Theory of Computing, 1999, pp. 312321; O. Barkol and Y. Rabani, Proceedings of the 32nd Annual ACM Symposium on Theory of Computing, 2000, pp. 388396; T. S. Jayram et al., J. Comput. System Sci., 69 (2004), pp. 435447]. We also give a cell probe algorithm that proves that our lower bound is optimal. Our proof uses a lower bound on the round complexity of the related communication problem. We show, additionally, that considerations of bit complexity alone cannot prove any nontrivial cell probe lower bound for the problem. This shows that the richness technique [P. B. Miltersen et al., J. Comput. System Sci., 57 (1998), pp. 3749] used in a lot of recent research around this problem would not have helped here. Our proof is based on information theoretic techniques for communication complexity, a theme that has been prominent in recent research [A. Chakrabarti et al., Proceedings of the 42nd Annual IEEE Symposium on Foundations of Computer Science, 2001, pp. 270278; Z. Bar-Yossef et al., Proceedings of the 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002, pp. 209218; P. Sen, Proceedings of the 18th Annual IEEE Conference on Computational Complexity, 2003, pp. 7383; R. Jain, J. Radhakrishnan, and P. Sen, Proceedings of the 30th International Colloquium on Automata, Languages and Programming, 2003, pp. 300315].

The Space Complexity of 2-Dimensional Approximate Range Counting.

Optimal Private Halfspace Counting via Discrepancy

Orthogonal Range Searching on the RAM, Revisited

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

On Range Summary Queries

An Optimal Randomized Cell Probe Lower Bound for Approximate Nearest Neighbor Searching

Range Queries on Uncertain Data.

Randomized Approximate Nearest Neighbor Search with Limited Adaptivity.

Multi-dimensional Approximate Counting

Optimal Planar Range Skyline Reporting with Linear Space in External Memory

In-Range Farthest Point Queries and Related Problem in High Dimensions

Range (Rényi) Entropy Queries and Partitioning

Space Efficient Multi-Dimensional Range Reporting

The Complexity of Distributed Approximation of Packing and Covering Integer Linear Programs

Approximation of Bounds on Mixed Level Orthogonal Arrays

On the Space Usage of Approximate Distance Oracles with Sub-2 Stretch

Approximation Algorithms for Finding Maximum Containing Circle and Sphere

Improved NP-Hardness of Approximation for Orthogonality Dimension and Minrank

On Efficient Approximation of the Maximum Distance to A Point Over an Intersection of Balls

On Two Dimensional Orthogonal Knapsack Problem

Approximating 1-dimensional TSP Requires Omega(n log n) Comparisons