Abstract:We consider the approximate nearest neighbor search problem on the Hamming cube $\{0,1\}^d$. We show that a randomized cell probe algorithm that uses polynomial storage and word size $d^{O(1)}$ requires a worst case query time of $\Omega({\rm log}\,{\rm log}\,d/{\rm log}\,{\rm log}\,{\rm log}\,d)$. The approximation factor may be as loose as $2^{{\rm log}^{1-\eta}d}$ for any fixed $\eta>0$. Our result fills a major gap in the study of this problem since all earlier lower bounds either did not allow randomization [A. Chakrabarti et al., A lower bound on the complexity of approximate nearest-neighbor searching on the Hamming cube, in Discrete and Computational Geometry, Springer, Berlin, 2003, pp. 313328; D. Liu, Inform. Process. Lett., 92 (2004), pp. 2329] or did not allow approximation [A. Borodin, R. Ostrovsky, and Y. Rabani, Proceedings of the 31st Annual ACM Symposium on Theory of Computing, 1999, pp. 312321; O. Barkol and Y. Rabani, Proceedings of the 32nd Annual ACM Symposium on Theory of Computing, 2000, pp. 388396; T. S. Jayram et al., J. Comput. System Sci., 69 (2004), pp. 435447]. We also give a cell probe algorithm that proves that our lower bound is optimal. Our proof uses a lower bound on the round complexity of the related communication problem. We show, additionally, that considerations of bit complexity alone cannot prove any nontrivial cell probe lower bound for the problem. This shows that the richness technique [P. B. Miltersen et al., J. Comput. System Sci., 57 (1998), pp. 3749] used in a lot of recent research around this problem would not have helped here. Our proof is based on information theoretic techniques for communication complexity, a theme that has been prominent in recent research [A. Chakrabarti et al., Proceedings of the 42nd Annual IEEE Symposium on Foundations of Computer Science, 2001, pp. 270278; Z. Bar-Yossef et al., Proceedings of the 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002, pp. 209218; P. Sen, Proceedings of the 18th Annual IEEE Conference on Computational Complexity, 2003, pp. 7383; R. Jain, J. Radhakrishnan, and P. Sen, Proceedings of the 30th International Colloquium on Automata, Languages and Programming, 2003, pp. 300315].

Tight Space Bounds for Two-Dimensional Approximate Range Counting

A 3-approximation algorithm for two-dimensional bin packing

Optimal Private Halfspace Counting via Discrepancy

Orthogonal Range Searching on the RAM, Revisited

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

Range Queries on Uncertain Data.

On Range Summary Queries

Nearly Tight Bounds on Testing of Metric Properties

Tight Space Lower Bound for Pseudo-Deterministic Approximate Counting

In-Range Farthest Point Queries and Related Problem in High Dimensions

Multi-dimensional Approximate Counting

Tight Bounds for the Subspace Sketch Problem with Applications

Space Efficient Multi-Dimensional Range Reporting

Approximation of Bounds on Mixed Level Orthogonal Arrays

Optimal Planar Range Skyline Reporting with Linear Space in External Memory

Semi-Group Range Sum Revisited: Query-Space Lower Bound Tightened

On the Space Usage of Approximate Distance Oracles with Sub-2 Stretch

On Two Dimensional Orthogonal Knapsack Problem

Improved Time and Space Bounds for Dynamic Range Mode

An Optimal Randomized Cell Probe Lower Bound for Approximate Nearest Neighbor Searching

Range (Rényi) Entropy Queries and Partitioning