On one-way functions and the average time complexity of almost-optimal compression

Marius Zimand

2024-12-04

Abstract:We show that one-way functions exist if and only there exists an efficient distribution relative to which almost-optimal compression is hard on average. The result is obtained by combining a theorem of Ilango, Ren, and Santhanam and one by Bauwens and Zimand.

Computational Complexity

What problem does this paper attempt to address?

On Building Fine-Grained One-Way Functions from Strong Average-Case Hardness

Chris Brzuska,Geoffroy Couteau

DOI: https://doi.org/10.1007/s00145-024-09518-1

2024-12-06

Journal of Cryptology

Abstract:Constructing one-way functions from average-case hardness is a long-standing open problem. A positive result would exclude Pessiland (Impagliazzo '95) and establish a highly desirable win–win situation: either (symmetric) cryptography exists unconditionally, or all problems can be solved efficiently on the average. Motivated by the lack of progress on this seemingly very hard question, we initiate the investigation of weaker yet meaningful candidate win–win results of the following type: either there are fine-grained one-way functions (FGOWF), or non-trivial speedups can be obtained for all problems on the average. FGOWFs only require a fixed polynomial gap (as opposed to superpolynomial) between the running time of the function and the running time of an inverter. We obtain three main results: Construction. We show that if there is an language having a very strong form of average-case hardness, which we call block finding hardness , then FGOWF exist. We provide heuristic support for this very strong average-case hardness notion by showing that it holds for a random language. Then, we study whether weaker (and more natural) forms of average-case hardness could already suffice to obtain FGOWF and obtain two negative results: Separation I. We provide a strong oracle separation for the implication ( exponentially average-case hard language FGOWF). Separation II. We provide a second strong negative result for an even weaker candidate win–win result. Namely, we rule out a relativizing proof for the implication ( exponentially average-case hard language whose hardness amplifies optimally through parallel repetitions FGOWF). This separation forms the core technical contribution of our work.

computer science, theory & methods,engineering, electrical & electronic,mathematics, applied
On the expected performance of path compression algorithms

Andrew Chi-Chih Yao

DOI: https://doi.org/10.1137/0214010

1985-01-01

SIAM Journal on Computing

Abstract:We consider the expected running time of an equivalence algorithm using the path compression rule (but not the weighting rule). An $O(n)$ expected running time is proved for the execution of a random equivalence program in the Spanning Tree Model.
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression

Yutong He,Xinmeng Huang,Yiming Chen,Wotao Yin,Kun Yuan

DOI: https://doi.org/10.48550/arXiv.2305.07612

2023-05-13

Abstract:Communication compression is an essential strategy for alleviating communication overhead by reducing the volume of information exchanged between computing nodes in large-scale distributed stochastic optimization. Although numerous algorithms with convergence guarantees have been obtained, the optimal performance limit under communication compression remains unclear. In this paper, we investigate the performance limit of distributed stochastic optimization algorithms employing communication compression. We focus on two main types of compressors, unbiased and contractive, and address the best-possible convergence rates one can obtain with these compressors. We establish the lower bounds for the convergence rates of distributed stochastic optimization in six different settings, combining strongly-convex, generally-convex, or non-convex functions with unbiased or contractive compressor types. To bridge the gap between lower bounds and existing algorithms' rates, we propose NEOLITHIC, a nearly optimal algorithm with compression that achieves the established lower bounds up to logarithmic factors under mild conditions. Extensive experimental results support our theoretical findings. This work provides insights into the theoretical limitations of existing compressors and motivates further research into fundamentally new compressor properties.

Machine Learning,Distributed, Parallel, and Cluster Computing,Optimization and Control
The Minimal Compression Rate for Similarity Identification

Amir Ingber,Tsachy Weissman

DOI: https://doi.org/10.48550/arXiv.1312.2063

2013-12-07

Information Theory

Abstract:Traditionally, data compression deals with the problem of concisely representing a data source, e.g. a sequence of letters, for the purpose of eventual reproduction (either exact or approximate). In this work we are interested in the case where the goal is to answer similarity queries about the compressed sequence, i.e. to identify whether or not the original sequence is similar to a given query sequence. We study the fundamental tradeoff between the compression rate and the reliability of the queries performed on compressed data. For i.i.d. sequences, we characterize the minimal compression rate that allows query answers, that are reliable in the sense of having a vanishing false-positive probability, when false negatives are not allowed. The result is partially based on a previous work by Ahlswede et al., and the inherently typical subset lemma plays a key role in the converse proof. We then characterize the compression rate achievable by schemes that use lossy source codes as a building block, and show that such schemes are, in general, suboptimal. Finally, we tackle the problem of evaluating the minimal compression rate, by converting the problem to a sequence of convex programs that can be solved efficiently.
Joint Data Compression and Caching: Approaching Optimality with Guarantees

Jian Li,Faheem Zafari,Don Towsley,Kin K. Leung,Ananthram Swami

DOI: https://doi.org/10.1145/3184407.3184410

2018-01-01

Abstract:We consider the problem of optimally compressing and caching data across a communication network. Given the data generated at edge nodes and a routing path, our goal is to determine the optimal data compression ratios and caching decisions across the network in order to minimize average latency, which can be shown to be equivalent to maximizing the compression and caching gain under an energy consumption constraint. We show that this problem is NP-hard in general and the hardness is caused by the caching decision subproblem, while the compression sub-problem is polynomial-time solvable. We then propose an approximation algorithm that achieves a (1-1/e)-approximation solution to the optimum in strongly polynomial time. We show that our proposed algorithm achieve the near-optimal performance in synthetic-based evaluations. In this paper, we consider a tree-structured network as an illustrative example, but our results easily extend to general network topology at the expense of more complicated notations.
On nonlinear compression costs: when Shannon meets Rényi

Andrea Somazzi,Paolo Ferragina,Diego Garlaschelli

DOI: https://doi.org/10.1109/ACCESS.2024.3406912

2023-10-28

Abstract:Shannon entropy is the shortest average codeword length a lossless compressor can achieve by encoding i.i.d. symbols. However, there are cases in which the objective is to minimize the \textit{exponential} average codeword length, i.e. when the cost of encoding/decoding scales exponentially with the length of codewords. The optimum is reached by all strategies that map each symbol $x_i$ generated with probability $p_i$ into a codeword of length $\ell^{(q)}_D(i)=-\log_D\frac{p_i^q}{\sum_{j=1}^Np_j^q}$. This leads to the minimum exponential average codeword length, which equals the Rényi, rather than Shannon, entropy of the source distribution. We generalize the established Arithmetic Coding (AC) compressor to this framework. We analytically show that our generalized algorithm provides an exponential average length which is arbitrarily close to the Rényi entropy, if the symbols to encode are i.i.d.. We then apply our algorithm to both simulated (i.i.d. generated) and real (a piece of Wikipedia text) datasets. While, as expected, we find that the application to i.i.d. data confirms our analytical results, we also find that, when applied to the real dataset (composed by highly correlated symbols), our algorithm is still able to significantly reduce the exponential average codeword length with respect to the classical `Shannonian' one. Moreover, we provide another justification of the use of the exponential average: namely, we show that by minimizing the exponential average length it is possible to minimize the probability that codewords exceed a certain threshold length. This relation relies on the connection between the exponential average and the cumulant generating function of the source distribution, which is in turn related to the probability of large deviations. We test and confirm our results again on both simulated and real datasets.

Information Theory,Data Structures and Algorithms,Data Analysis, Statistics and Probability
Zero-Error Distributed Function Compression for Binary Arithmetic Sum

Xuan Guang,Ruze Zhang

2023-05-11

Abstract:In this paper, we put forward the model of zero-error distributed function compression system of two binary memoryless sources X and Y, where there are two encoders En1 and En2 and one decoder De, connected by two channels (En1, De) and (En2, De) with the capacity constraints C1 and C2, respectively. The encoder En1 can observe X or (X,Y) and the encoder En2 can observe Y or (X,Y) according to the two switches s1 and s2 open or closed (corresponding to taking values 0 or 1). The decoder De is required to compress the binary arithmetic sum f(X,Y)=X+Y with zero error by using the system multiple times. We use (s1s2;C1,C2;f) to denote the model in which it is assumed that C1 \geq C2 by symmetry. The compression capacity for the model is defined as the maximum average number of times that the function f can be compressed with zero error for one use of the system, which measures the efficiency of using the system. We fully characterize the compression capacities for all the four cases of the model (s1s2;C1,C2;f) for s1s2= 00,01,10,11. Here, the characterization of the compression capacity for the case (01;C1,C2;f) with C1>C2 is highly nontrivial, where a novel graph coloring approach is developed. Furthermore, we apply the compression capacity for (01;C1,C2;f) to an open problem in network function computation that whether the best known upper bound of Guang et al. on computing capacity is in general tight.

Information Theory
The Tale of One-way Functions

Leonid A. Levin

DOI: https://doi.org/10.48550/arXiv.cs/0012023

2003-08-18

Abstract:The existence of one-way functions is arguably the most important problem in computer theory. The article discusses and refines a number of concepts relevant to this problem. For instance, it gives the first combinatorial complete owf, i.e., a function which is one-way if any function is. There are surprisingly many subtleties in basic definitions. Some of these subtleties are discussed or hinted at in the literature and some are overlooked. Here, a unified approach is attempted.

Cryptography and Security,Computational Complexity
Generalized one-way function and its application

Hua-Lei Yin

2024-08-24

Abstract:One-way functions are fundamental to classical cryptography and their existence remains a longstanding problem in computational complexity theory. Recently, a provable quantum one-way function has been identified, which maintains its one-wayness even with unlimited computational resources. Here, we extend the mathematical definition of functions to construct a generalized one-way function by virtually measuring the qubit of provable quantum one-way function and randomly assigning the corresponding measurement outcomes with identical probability. Remarkably, using this generalized one-way function, we have developed an unconditionally secure key distribution protocol based solely on classical data processing, which can then utilized for secure encryption and signature. Our work highlights the importance of information in characterizing quantum systems and the physical significance of the density matrix. We demonstrate that probability theory and randomness are effective tools for countering adversaries with unlimited computational capabilities.

Quantum Physics,Computational Complexity,Cryptography and Security,Information Theory
Computable one-way functions on the reals

George Barmpalias,Xiaoyan Zhang

2024-06-22

Abstract:A major open problem in computational complexity is the existence of a one-way function, namely a function from strings to strings which is computationally easy to compute but hard to invert. Levin (2023) formulated the notion of one-way functions from reals (infinite bit-sequences) to reals in terms of computability, and asked whether partial computable one-way functions exist. We give a strong positive answer using the hardness of the halting problem and exhibiting a total computable one-way function.

Computational Complexity,Information Theory,Logic
(Almost) Optimal Constructions of UOWHFs from 1-to-1, Regular One-Way Functions and Beyond

Yu,Dawu Gu,Xiangxue Li,Jian Weng

DOI: https://doi.org/10.1007/978-3-662-48000-7_11

2015-01-01

Abstract:We revisit the problem of black-box constructions of universal one-way hash functions (UOWHFs) from several typical classes of one-way functions (OWFs), and give respective constructions that either improve or generalize the best previously known.- For any 1-to-1 one-way function, we give an optimal construction of UOWHFs with key and output length Theta(n) by making a single call to the underlying OWF. This improves the constructions of Naor and Yung (STOC 1989) and De Santis and Yung (Eurocrypt 1990) that need key length O(n . omega(log n)).- For any known-(almost-) regular one-way function with known hardness, we give an optimal construction of UOWHFs with key and output length Theta(n) and a single call to the one-way function.- For any known-(almost-) regular one-way function, we give a construction of UOWHFs with key and output length O(n.omega(1)) and by making omega(1) non-adaptive calls to the one-way function. This improves the construction of Barhum and Maurer (Latincrypt 2012) that requires key and output length O(n.omega(log n)) and omega(log n) calls.- For any weakly-regular one-way function introduced by Yu et al. at TCC 2015 (i.e., the set of inputs with maximal number of siblings is of an n(-c)-fraction for some constant c), we give a construction of UOWHFs with key length O(n.logn) and output length Theta(n). This generalizes the construction of Ames et al. (Asiacrypt 2012) which requires an unknown-regular one-way function (i.e., c = 0).Along the way, we use several techniques that might be of independent interest. We show that almost 1-to-1 (except for a negligible fraction) one-way functions and known (almost-) regular one-way functions are equivalent in the known-hardness (or non-uniform) setting, by giving an optimal construction of the former from the latter. In addition, we show how to transform any one-way function that is far from regular (but only weakly regular on a noticeable fraction of domain) into an almost-regular one-way function.
On the Computational Hardness of Quantum One-Wayness

Bruno Cavalar,Eli Goldin,Matthew Gray,Peter Hall,Yanyi Liu,Angelos Pelecanos

2023-12-21

Abstract:There is a large body of work studying what forms of computational hardness are needed to realize classical cryptography. In particular, one-way functions and pseudorandom generators can be built from each other, and thus require equivalent computational assumptions to be realized. Furthermore, the existence of either of these primitives implies that $\rm{P} \neq \rm{NP}$, which gives a lower bound on the necessary hardness. One can also define versions of each of these primitives with quantum output: respectively one-way state generators and pseudorandom state generators. Unlike in the classical setting, it is not known whether either primitive can be built from the other. Although it has been shown that pseudorandom state generators for certain parameter regimes can be used to build one-way state generators, the implication has not been previously known in full generality. Furthermore, to the best of our knowledge, the existence of one-way state generators has no known implications in complexity theory. We show that pseudorandom states compressing $n$ bits to $\log n + 1$ qubits can be used to build one-way state generators and pseudorandom states compressing $n$ bits to $\omega(\log n)$ qubits are one-way state generators. This is a nearly optimal result since pseudorandom states with fewer than $c \log n$-qubit output can be shown to exist unconditionally. We also show that any one-way state generator can be broken by a quantum algorithm with classical access to a $\rm{PP}$ oracle. An interesting implication of our results is that a $t(n)$-copy one-way state generator exists unconditionally, for every $t(n) = o(n/\log n)$. This contrasts nicely with the previously known fact that $O(n)$-copy one-way state generators require computational hardness. We also outline a new route towards a black-box separation between one-way state generators and quantum bit commitments.

Cryptography and Security,Computational Complexity,Quantum Physics
Optimal (Euclidean) Metric Compression

Piotr Indyk,Tal Wagner

DOI: https://doi.org/10.48550/arXiv.2110.03152

2021-10-07

Abstract:We study the problem of representing all distances between $n$ points in $\mathbb R^d$, with arbitrarily small distortion, using as few bits as possible. We give asymptotically tight bounds for this problem, for Euclidean metrics, for $\ell_1$ (a.k.a.~Manhattan) metrics, and for general metrics. Our bounds for Euclidean metrics mark the first improvement over compression schemes based on discretizing the classical dimensionality reduction theorem of Johnson and Lindenstrauss (Contemp.~Math.~1984). Since it is known that no better dimension reduction is possible, our results establish that Euclidean metric compression is possible beyond dimension reduction.

Computational Geometry,Data Structures and Algorithms
Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Shuichi Hirahara,Zhenjian Lu,Mikito Nanashima

2024-09-19

Abstract:The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to obtaining fundamental results in average-case complexity, yet whether any samplable distribution admits a coding theorem for randomized time-bounded Kolmogorov complexity ($\mathsf{rK}^\mathsf{poly}$) is open and a common bottleneck in the recent literature of meta-complexity. Previous works bypassed this issue by considering probabilistic Kolmogorov complexity ($\mathsf{pK}^\mathsf{poly}$), in which public random bits are assumed to be available. In this paper, we present an efficient coding theorem for randomized Kolmogorov complexity under the non-existence of one-way functions, thereby removing the common bottleneck. This enables us to prove $\mathsf{rK}^\mathsf{poly}$ counterparts of virtually all the average-case results that were proved only for $\mathsf{pK}^\mathsf{poly}$, and enables the resolution of the open problems of Hirahara, Ilango, Lu, Nanashima, and Oliveira (STOC'23) and Hirahara, Kabanets, Lu, and Oliveira (CCC'24). The key technical lemma is that any distribution whose next bits are efficiently predictable admits an efficient encoding and decoding scheme, which could be of independent interest to data compression.

Computational Complexity
The Existence of Relativization One-Way Functions

曹子宁,吕义忠,石纯一

DOI: https://doi.org/10.13328/j.cnki.jos.2001.06.013

2001-01-01

Ruan Jian Xue Bao/Journal of Software

Abstract:One-Way functions play an important role in complexity theory of computation and public-key cryptography. Inspired by the work of Grollmann and Selman, the work of Grollmann and Selman to the result of relativization and nonuniform complexity classes are generalized in this paper, the equivalence of the include relation of complexity class UP/poly, UP, P/poly and the existence of strongly relativization one-way function, weakly relativization one-way function are proved.
On Distributed Computing for Functions with Certain Structures

Shigeaki Kuzuoka,Shun Watanabe

DOI: https://doi.org/10.48550/arXiv.1602.08204

2017-07-07

Abstract:The problem of distributed function computation is studied, where functions to be computed is not necessarily symbol-wise. A new method to derive a converse bound for distributed computing is proposed; from the structure of functions to be computed, information that is inevitably conveyed to the decoder is identified, and the bound is derived in terms of the optimal rate needed to send that information. The class of informative functions is introduced, and, for the class of smooth sources, the optimal rate for computing those functions is characterized. Furthermore, for i.i.d. sources with joint distribution that may not be full support, functions that are composition of symbol-wise function and the type of a sequence are considered, and the optimal rate for computing those functions is characterized in terms of the hypergraph entropy. As a byproduct, our method also provides a conceptually simple proof of the known fact that computing a Boolean function may require as large rate as reproducing the entire source.

Information Theory
One-Way Functions in Worst-Case Cryptography: Algebraic and Security Properties

A. Beygelzimer,L. A. Hemaspaandra,C. M. Homan,J. Rothe

DOI: https://doi.org/10.48550/arXiv.cs/9911007

1999-11-15

Computational Complexity

Abstract:We survey recent developments in the study of (worst-case) one-way functions having strong algebraic and security properties. According to [RS93], this line of research was initiated in 1984 by Rivest and Sherman who designed two-party secret-key agreement protocols that use strongly noninvertible, total, associative one-way functions as their key building blocks. If commutativity is added as an ingredient, these protocols can be used by more than two parties, as noted by Rabi and Sherman [RS93] who also developed digital signature protocols that are based on such enhanced one-way functions. Until recently, it was an open question whether one-way functions having the algebraic and security properties that these protocols require could be created from any given one-way function. Recently, Hemaspaandra and Rothe [HR99] resolved this open issue in the affirmative, by showing that one-way functions exist if and only if strong, total, commutative, associative one-way functions exist. We discuss this result, and the work of Rabi, Rivest, and Sherman, and recent work of Homan [Hom99] that makes progress on related issues.
Applications of Common Information to Computing Functions

Derya Malak

DOI: https://doi.org/10.48550/arXiv.2103.16717

2021-03-31

Abstract:We design a low complexity distributed compression scheme for computing arbitrary functions of sources with discrete alphabets. We use a helper-based method that extends the definition of the G{á}cs-K{ö}rner-Witsenhausen (GKW) common information to functional common information. The helper relaxes the combinatorial structure of GKW by partitioning the joint source distribution into nests imposed by the function, which ensures hierarchical cooperation between the sources for effectively distributed computing. By contrasting our approach's performance with existing efficient techniques, we demonstrate the rate savings in recovering function and source data. Permutation invariant functions are prevalent in learning and combinatorial optimization fields and most recently applied to graph neural networks. We consider the efficient compression for computing permutation invariant functions in a network with two sources and one decoder. We use a bipartite graph representation, where two disjoint sets of vertices (parts) denote the individual source graphs and the edge weights capture the joint source distribution. We compress bipartite graphs by creating connected components determined by the function's distribution, accounting for the edge symmetries, and eliminating the low probability edges. We separately encode those edges and send them as refinements. Our approach can substitute high complexity joint decoding techniques and inform neural networks to reduce the computing time and reduce complexity.

Information Theory,Networking and Internet Architecture
How to Compress the Solution

Samuel Epstein

DOI: https://doi.org/10.48550/arXiv.2303.05616

2023-09-07

Abstract:Using derandomization, we provide an upper bound on the compression size of solutions to the graph coloring problem. In general, if solutions to a combinatorial problem exist with high probability and the probability is simple, then there exists a simple solution to the problem. Otherwise the problem instance has high mutual information with the halting problem.

Computational Complexity
Optimal Compression of Unit Norm Vectors in the High Distortion Regime

Heng Zhu,Avishek Ghosh,Arya Mazumdar

2024-02-05

Abstract:Motivated by the need for communication-efficient distributed learning, we investigate the method for compressing a unit norm vector into the minimum number of bits, while still allowing for some acceptable level of distortion in recovery. This problem has been explored in the rate-distortion/covering code literature, but our focus is exclusively on the "high-distortion" regime. We approach this problem in a worst-case scenario, without any prior information on the vector, but allowing for the use of randomized compression maps. Our study considers both biased and unbiased compression methods and determines the optimal compression rates. It turns out that simple compression schemes are nearly optimal in this scenario. While the results are a mix of new and known, they are compiled in this paper for completeness.

Information Theory,Distributed, Parallel, and Cluster Computing,Machine Learning

On one-way functions and the average time complexity of almost-optimal compression

On Building Fine-Grained One-Way Functions from Strong Average-Case Hardness

On the expected performance of path compression algorithms

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression

The Minimal Compression Rate for Similarity Identification

Joint Data Compression and Caching: Approaching Optimality with Guarantees

On nonlinear compression costs: when Shannon meets Rényi

Zero-Error Distributed Function Compression for Binary Arithmetic Sum

The Tale of One-way Functions

Generalized one-way function and its application

Computable one-way functions on the reals

(Almost) Optimal Constructions of UOWHFs from 1-to-1, Regular One-Way Functions and Beyond

On the Computational Hardness of Quantum One-Wayness

Optimal (Euclidean) Metric Compression

Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

The Existence of Relativization One-Way Functions

On Distributed Computing for Functions with Certain Structures

One-Way Functions in Worst-Case Cryptography: Algebraic and Security Properties

Applications of Common Information to Computing Functions

How to Compress the Solution

Optimal Compression of Unit Norm Vectors in the High Distortion Regime