On the computational power of $C$-random strings

Alexey Milovanov

DOI: https://doi.org/10.48550/arXiv.2409.04448

2024-08-24

Abstract:Denote by $H$ the Halting problem. Let $R_U: = \{ x | C_U(x) \ge |x|\}$, where $C_U(x)$ is the plain Kolmogorov complexity of $x$ under a universal decompressor $U$. We prove that there exists a universal $U$ such that $H \in P^{R_U}$, solving the problem posted by Eric Allender.

Computational Complexity

What problem does this paper attempt to address?

Reductions to the set of random strings: The resource-bounded case

Eric Allender,Harry Buhrman,Luke Friedman,Bruno Loff

DOI: https://doi.org/10.2168/LMCS-10%283%3A5%292014

2014-08-17

Abstract:This paper is motivated by a conjecture that BPP can be characterized in terms of polynomial-time nonadaptive reductions to the set of Kolmogorov-random strings. In this paper we show that an approach laid out in [Allender et al] to settle this conjecture cannot succeed without significant alteration, but that it does bear fruit if we consider time-bounded Kolmogorov complexity instead. We show that if a set A is reducible in polynomial time to the set of time-t-bounded Kolmogorov random strings (for all large enough time bounds t), then A is in P/poly, and that if in addition such a reduction exists for any universal Turing machine one uses in the definition of Kolmogorov complexity, then A is in PSPACE.

Computational Complexity,Logic in Computer Science
Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Shuichi Hirahara,Zhenjian Lu,Mikito Nanashima

2024-09-19

Abstract:The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to obtaining fundamental results in average-case complexity, yet whether any samplable distribution admits a coding theorem for randomized time-bounded Kolmogorov complexity ($\mathsf{rK}^\mathsf{poly}$) is open and a common bottleneck in the recent literature of meta-complexity. Previous works bypassed this issue by considering probabilistic Kolmogorov complexity ($\mathsf{pK}^\mathsf{poly}$), in which public random bits are assumed to be available. In this paper, we present an efficient coding theorem for randomized Kolmogorov complexity under the non-existence of one-way functions, thereby removing the common bottleneck. This enables us to prove $\mathsf{rK}^\mathsf{poly}$ counterparts of virtually all the average-case results that were proved only for $\mathsf{pK}^\mathsf{poly}$, and enables the resolution of the open problems of Hirahara, Ilango, Lu, Nanashima, and Oliveira (STOC'23) and Hirahara, Kabanets, Lu, and Oliveira (CCC'24). The key technical lemma is that any distribution whose next bits are efficiently predictable admits an efficient encoding and decoding scheme, which could be of independent interest to data compression.

Computational Complexity
Effective Aspects of Algorithmically Random Structures

Matthew Harrison-Trainor,Bakh Khoussainov,Daniel Turetsky

DOI: https://doi.org/10.3233/com-180101

2019-01-01

Computability

Abstract:In this paper we study various properties of algorithmically random infinite structures. Our results address the following questions. How would one define algorithmic randomness for infinite structures? Could algorithmically random structures be computable? What are the similarities and differences between algorithmically random structures and algorithmically random infinite strings? What are the possible Turing degrees of algorithmically random structures? Are there algorithmically random infinite groups? For instance, we prove the following in this paper: (1) there are classes which contain algorithmically random yet computable structures, (2) there exist algorithmically random universal algebras with co-computably enumerable as well as computably enumerable word problems, (3) there are natural classes of structures in which the Turing degrees of algorithmically random structures can only be either computable or equivalent to the halting set, and (4) there are examples of algorithmically random groups. The first result shows a dramatic difference between algorithmically random strings and algorithmically random structures. The second result significantly improves the known theorem that algorithmically random structures computable in the halting set exist; these examples of algebras are sharp in terms of arithmetical hierarchy of the word problem for random algebras. The third result is a dichotomy theorem that characterises all possible Turing degrees of algorithmically random structures. Finally, the fourth result answers a nontrivial open question about the existence of algorithmically random groups.
The Chvátal-Sankoff problem: Understanding random string comparison through stochastic processes

Alexander Tiskin

2024-08-14

Abstract:Given two equally long, uniformly random binary strings, the expected length of their longest common subsequence (LCS) is asymptotically proportional to the strings' length. Finding the proportionality coefficient $\gamma$, i.e. the limit of the normalised LCS length for two random binary strings of length $n \to \infty$, is a very natural problem, first posed by Chvátal and Sankoff in 1975, and as yet unresolved. This problem has relevance to diverse fields ranging from combinatorics and algorithm analysis to coding theory and computational biology. Using methods of statistical mechanics, as well as some existing results on the combinatorial structure of LCS, we link constant $\gamma$ to the parameters of a certain stochastic particle process, which we use to obtain a new estimate for $\gamma$.

Combinatorics,Discrete Mathematics,Probability
On Kolmogorov Structure Functions

Samuel Epstein

2024-07-10

Abstract:All strings with low mutual information with the halting sequence will have flat Kolmogorov Structure Functions, in the context of Algorithmic Statistics. Assuming the Independence Postulate, strings with non-negligible information with the halting sequence are purely mathematical constructions, and cannot be found in nature. Thus Algorithmic Statistics does not study strings in the physical world. This leads to the general thesis that two part codes require limitations as shown in the Minimum Description Length Principle. We also discuss issues with set-restricted Kolmogorov Structure Functions.

Computational Complexity
The EL Theorem

Samuel Epstein

2023-09-10

Abstract:The combined universal probability $\mathbf{m}(D)$ of strings $x$ in sets $D$ is close to max $\mathbf{m}(x)$ over $x$ in $D$: their logs differ by at most $D$'s information $\mathbf{I}(D:\mathcal{H})$ about the halting sequence $\mathcal{H}$.

Computational Complexity,Logic
The Ginsburg--Sands theorem and computability theory

Heidi Benham,Andrew De Lapo,Damir Dzhafarov,Reed Solomon,Java Darleen Villano

2024-06-26

Abstract:The Ginsburg--Sands theorem from topology states that every infinite topological space has an infinite subspace homeomorphic to exactly one of the following five topologies on $\omega$: indiscrete, discrete, initial segment, final segment, and cofinite. The original proof is nonconstructive, and features an interesting application of Ramsey's theorem for pairs ($\mathsf{RT}^2_2$). We analyze this principle in computability theory and reverse mathematics, using Dorais's formalization of CSC spaces. Among our results are that the Ginsburg-Sands theorem for CSC spaces is equivalent to $\mathsf{ACA}_0$, while for Hausdorff spaces it is provable in $\mathsf{RCA}_0$. Furthermore, if we enrich a CSC space by adding the closure operator on points, then the Ginsburg-Sands theorem turns out to be equivalent to the chain/antichain principle ($\mathsf{CAC}$). The most surprising case is that of the Ginsburg-Sands theorem restricted to $T_1$ spaces. Here, we show that the principle lies strictly between $\mathsf{ACA}_0$ and $\mathsf{RT}^2_2$, yielding arguably the first natural theorem from outside logic to occupy this interval. As part of our analysis of the $T_1$ case we introduce a new class of purely combinatorial principles below $\mathsf{ACA}_0$ and not implied by $\mathsf{RT}^2_2$ which form a strict hierarchy generalizing the stable Ramsey's theorem for pairs ($\mathsf{SRT}^2_2$). We show that one of these, the $\Sigma^0_2$ subset principle ($\Sigma^0_2$-$\mathsf{Subset}$), has the property that it, together with the cohesive principle ($\mathsf{COH}$), is equivalent over $\mathsf{RCA}_0$ to the Ginsburg--Sands theorem for $T_1$ CSC spaces.

Logic
The Kolmogorov Complexity of Random Reals

L Yu,DC Ding,R Downey

DOI: https://doi.org/10.1016/j.apal.2004.01.006

IF: 0.776

2004-01-01

Annals of Pure and Applied Logic

Abstract:We investigate the initial segment complexity of random reals. Let K(σ) denote prefix-free Kolmogorov complexity. A natural measure of the relative randomness of two reals α and β is to compare complexity K(α↾n) and K(β↾n). It is well-known that a real α is 1-random iff there is a constant c such that for all n, K(α↾n)⩾n−c. We ask the question, what else can be said about the initial segment complexity of random reals. Thus, we study the fine behaviour of K(α↾n) for random α. Following work of Downey, Hirschfeldt and LaForte, we say that α⩽Kβ iff there is a constant O(1) such that for all n, K(α↾n)⩽K(β↾n)+O(1). We call the equivalence classes under this measure of relative randomness K-degrees. We give proofs that there is a random real α so that limsupnK(α↾n)−K(Ω↾n)=∞ where Ω is Chaitin's random real. One is based upon (unpublished) work of Solovay, and the other exploits a new idea. Further, based on this new idea, we prove there are uncountably many K-degrees of random reals by proving that μ({β:β⩽Kα})=0. As a corollary to the proof we can prove there is no largest K-degree. Finally we prove that if n≠m then the initial segment complexities of the natural n- and m-random sets (namely Ω∅(n−1) and Ω∅(m−1)) are different. The techniques introduced in this paper have already found a number of other applications.
Undecidability in binary tag systems and the Post correspondence problem for four pairs of words

Turlough Neary

DOI: https://doi.org/10.48550/arXiv.1312.6700

2013-12-20

Abstract:Since Cocke and Minsky proved 2-tag systems universal, they have been extensively used to prove the universality of numerous computational models. Unfortunately, all known algorithms give universal 2-tag systems that have a large number of symbols. In this work, tag systems with only 2 symbols (the minimum possible) are proved universal via an intricate construction showing that they simulate cyclic tag systems. Our simulation algorithm has a polynomial time overhead, and thus shows that binary tag systems simulate Turing machines in polynomial time. We immediately find applications of our result. We reduce the halting problem for binary tag systems to the Post correspondence problem for 4 pairs of words. This improves on 7 pairs, the previous bound for undecidability in this problem. Following our result, only the case for 3 pairs of words remains open, as the problem is known to be decidable for 2 pairs. As a further application, we find that the matrix mortality problem is undecidable for sets with five $3\times 3$ matrices and for sets with two $15\times 15$ matrices. The previous bounds for the undecidability in this problem was seven $3\times 3$ matrices and two $ 21\times 21$ matrices.

Formal Languages and Automata Theory,Data Structures and Algorithms
Power of Randomization in Automata on Infinite Strings

Rohit Chadha,A. Prasad Sistla,Mahesh Viswanathan

DOI: https://doi.org/10.2168/lmcs-7(3:22)2011

2011-09-29

Logical Methods in Computer Science

Abstract:Probabilistic B\"uchi Automata (PBA) are randomized, finite state automata that process input strings of infinite length. Based on the threshold chosen for the acceptance probability, different classes of languages can be defined. In this paper, we present a number of results that clarify the power of such machines and properties of the languages they define. The broad themes we focus on are as follows. We present results on the decidability and precise complexity of the emptiness, universality and language containment problems for such machines, thus answering questions central to the use of these models in formal verification. Next, we characterize the languages recognized by PBAs topologically, demonstrating that though general PBAs can recognize languages that are not regular, topologically the languages are as simple as \omega-regular languages. Finally, we introduce Hierarchical PBAs, which are syntactically restricted forms of PBAs that are tractable and capture exactly the class of \omega-regular languages.

computer science, theory & methods,logic
Representation Theory of Compact Metric Spaces and Computational Complexity of Continuous Data

Akitoshi Kawamura,Donghyun Lim,Svetlana Selivanova,Martin Ziegler

DOI: https://doi.org/10.48550/arXiv.1809.08695

2018-09-23

Logic in Computer Science

Abstract:Choosing an encoding over binary strings for input/output to/by a Turing Machine is usually straightforward and/or inessential for discrete data (like graphs), but delicate -- heavily affecting computability and even more computational complexity -- already regarding real numbers, not to mention more advanced (e.g. Sobolev) spaces. For a general theory of computational complexity over continuous data we introduce and justify QUANTITATIVE admissibility as requirement for sensible encodings of arbitrary compact metric spaces, a refinement of qualitative 'admissibility' due to [Kreitz&Weihrauch'85]: An admissible representation of a T0 space $X$ is a (i) continuous partial surjective mapping from the Cantor space of infinite binary sequences which is (ii) maximal w.r.t. continuous reduction. By the Kreitz-Weihrauch (aka "Main") Theorem of computability over continuous data, for fixed spaces $X,Y$ equipped with admissible representations, a function $f:X\to Y$ is continuous iff it admits continuous a code-translating mapping on Cantor space, a so-called REALIZER. We define a QUANTITATIVELY admissible representation of a compact metric space $X$ to have (i) asymptotically optimal modulus of continuity, namely close to the entropy of $X$, and (ii) be maximal w.r.t. reduction having optimal modulus of continuity in a similar sense. Careful constructions show the category of such representations to be Cartesian closed, and non-empty: every compact $X$ admits a linearly-admissible representation. Moreover such representations give rise to a tight quantitative correspondence between the modulus of continuity of a function $f:X\to Y$ on the one hand and on the other hand that of its realizer: the MAIN THEOREM of computational complexity. This suggests (how) to take into account the entropies of the spaces under consideration when measuring algorithmic cost over continuous data.
A correspondence between the time and space complexity

Ivan V. Latkin

2023-11-02

Abstract:We investigate the correspondence between the time and space recognition complexity of languages; for this purpose, we will code the long-continued computations of deterministic two-tape Turing machines by the relatively short-length quantified Boolean formulae. The modified Stockmeyer and Meyer method will appreciably be used for this simulation. It will be proved using this modeling that the complexity classes $\mathbf{EXP}$ and $\mathbf{PSPACE}$ coincide; and more generally, the class $(k\!+\!1)$-fold Deterministic Exponential Time equals to the class $k$-fold Deterministic Exponential Space for each $k\geqslant1$; the space complexity of the languages of the class $\mathbf{P}$ will also be studied. Furthermore, this allows us to slightly improve the early founded lower complexity bound of decidable theories that are nontrivial relative to some equivalence relation (this relation may be equality) -- each of these theories is consistent with the formula, which asserts that there are two non-equivalent elements. Keywords: computational complexity, the coding of computations through formulae, exponential time, polynomial space, lower complexity bound of the language recognition

Computational Complexity,Logic in Computer Science,Logic
Maximal Chains in the Turing Degrees

C. T. Chong,Liang Yu

DOI: https://doi.org/10.2178/jsl/1203350783

2007-01-01

Journal of Symbolic Logic

Abstract:We study the problem of existence of maximal chains in the Turing degrees. We show that:1. ZF + DC + "There exists no maximal chain in the Turing degrees" is equiconsistent with ZFC + "There exists an inaccessible cardinal";2. For all a is an element of 2(omega), (omega(1))(L[u]) = omega(1) if and only if there exists a Pi(1)(1)[a] maximal chain in the Turing degrees.As a corollary, ZFC + "There exists an inaccessible cardinal" is equiconsistent with ZFC + "There is no (boldface) Pi(1)(1) maximal chain of Turing degrees".
On the Computation of Distances for Probabilistic Context-Free Grammars

Colin de la Higuera,James Scicluna,Mark-Jan Nederhof

DOI: https://doi.org/10.48550/arXiv.1407.1513

2014-07-07

Abstract:Probabilistic context-free grammars (PCFGs) are used to define distributions over strings, and are powerful modelling tools in a number of areas, including natural language processing, software engineering, model checking, bio-informatics, and pattern recognition. A common important question is that of comparing the distributions generated or modelled by these grammars: this is done through checking language equivalence and computing distances. Two PCFGs are language equivalent if every string has identical probability with both grammars. This also means that the distance (whichever norm is used) is null. It is known that the language equivalence problem is interreducible with that of multiple ambiguity for context-free grammars, a long-standing open question. In this work, we prove that computing distances corresponds to solving undecidable questions: this is the case for the L1, L2 norm, the variation distance and the Kullback-Leibler divergence. Two more results are less negative: 1. The most probable string can be computed, and, 2. The Chebyshev distance (where the distance between two distributions is the maximum difference of probabilities over all strings) is interreducible with the language equivalence problem.

Formal Languages and Automata Theory
Computability in infinite Galois theory and algorithmically random algebraic fields

Wesley Calvert,Valentina Harizanov,Alexandra Shlapentokh

2024-07-04

Abstract:We introduce a notion of algorithmic randomness for algebraic fields. We prove the existence of a continuum of algebraic extensions of $\mathbb{Q}$ that are random according to our definition. We show that there are noncomputable algebraic fields which are not random. We also partially characterize the index set, relative to an oracle, of the set of random algebraic fields computable relative to that oracle. In order to carry out this investigation of randomness for fields, we develop computability in the context of infinite Galois theory (where the relevant Galois groups are uncountable), including definitions of computable and computably enumerable Galois groups and computability of Haar measure on the Galois groups.

Logic,Number Theory
Computability Theory of Closed Timelike Curves

Scott Aaronson,Mohammad Bavarian,Toby Cubitt,Sabee Grewal,Giulio Gueltrini,Ryan O'Donnell,Marien Raat

2024-10-15

Abstract:We study the question of what is computable by Turing machines equipped with time travel into the past; i.e., with Deutschian closed timelike curves (CTCs) having no bound on their width or length. An alternative viewpoint is that we study the complexity of finding approximate fixed points of computable Markov chains and quantum channels of countably infinite dimension. Our main result is that the complexity of these problems is precisely $\Delta_2$, the class of languages Turing-reducible to the Halting problem. Establishing this as an upper bound for qubit-carrying CTCs requires recently developed results in the theory of quantum Markov maps.

Quantum Physics
On Initial Segment Complexity and Degrees of Randomness

Joseph S. Miller,Liang Yu

DOI: https://doi.org/10.1090/s0002-9947-08-04395-x

IF: 1.3529

2008-01-01

Transactions of the American Mathematical Society

Abstract:One approach to understanding the. ne structure of initial segment complexity was introduced by Downey, Hirschfeldt and LaForte. They define X <=(K) Y to mean that (for all n) K( X vertical bar n) <= K(Y vertical bar n) + O( 1). The equivalence classes under this relation are the K-degrees. We prove that if X circle plus Y is 1-random, then X and Y have no upper bound in the K-degrees (hence, no join). We also prove that n-randomness is closed upward in the K-degrees. Our main tool is another structure intended to measure the degree of randomness of real numbers: the nu L-degrees. Unlike the K-degrees, many basic properties of the nu L-degrees are easy to prove. We show that X <=(K) Y implies X <=(nu L) Y, so some results can be transferred. The reverse implication is proved to fail. The same analysis is also done for <=(C), the analogue of <=(K) for plain Kolmogorov complexity.Two other interesting results are included. First, we prove that for any Z is an element of 2(omega), a 1-random real computable from a 1-Z-random real is automatically 1-Z-random. Second, we give a plain Kolmogorov complexity characterization of 1-randomness. This characterization is related to our proof that X <=(C) Y implies X <=(nu L) Y.
State Complexity of Binary Coded Regular Languages

Viliam Geffert,Dominika Pališínová,Alexander Szabari

DOI: https://doi.org/10.1016/j.tcs.2024.114399

IF: 1.002

2024-01-19

Theoretical Computer Science

Abstract:For the given non-unary input alphabet Σ, a maximal prefix code h mapping strings over Σ to binary strings, and an optimal deterministic finite automaton (DFA) A with n states recognizing a language L over Σ, we consider the problem of how many states we need for an automaton A′ that decides membership in h(L) , the binary coded version of L . Namely, A′ accepts binary inputs belonging to h(L) and rejects binary inputs belonging to h(LC) , where LC is the complement of L . The outcome on inputs that are not valid binary codes for any string in Σ⁎ can be arbitrary: A′ may accept, reject, or halt in a "don't care" state. We show that every optimal deterministic don't care finite automaton (dcDFA) A′ solving this promise problem uses at most (‖Σ‖−1)⋅n states but at least n states. In addition, we have established a kind of pseudo-isomorphism between such DFAs and dcDFAs. We also show that, for each non-unary input alphabet Σ, there exists a maximal binary prefix code h such that, for each n≥2 and for each N in range from n to (‖Σ‖−1)⋅n , there exists a language L over Σ such that the optimal DFA recognizing L uses exactly n states and every optimal dcDFA for solving the above promise problem uses exactly N states. Thus, we have the complete state hierarchy for deciding membership in the binary coded version of L , with no magic numbers in between the lower and upper bounds.

computer science, theory & methods
Probing quantum complexity via universal saturation of stabilizer entropies

Tobias Haug,Leandro Aolita,M.S. Kim

2024-07-12

Abstract:Nonstabilizerness or `magic' is a key resource for quantum computing and a necessary condition for quantum advantage. Non-Clifford operations turn stabilizer states into resourceful states, where the amount of nonstabilizerness is quantified by resource measures such as stabilizer Rényi entropies (SREs). Here, we show that SREs saturate their maximum value at a critical number of non-Clifford operations. Close to the critical point SREs show universal behavior. Remarkably, the derivative of the SRE crosses at the same point independent of the number of qubits and can be rescaled onto a single curve. We find that the critical point depends non-trivially on Rényi index $\alpha$. For random Clifford circuits doped with T-gates, the critical T-gate density scales independently of $\alpha$. In contrast, for random Hamiltonian evolution, the critical time scales linearly with qubit number for $\alpha>1$, while is a constant for $\alpha<1$. This highlights that $\alpha$-SREs reveal fundamentally different aspects of nonstabilizerness depending on $\alpha$: $\alpha$-SREs with $\alpha<1$ relate to Clifford simulation complexity, while $\alpha>1$ probe the distance to the closest stabilizer state and approximate state certification cost via Pauli measurements. As technical contributions, we observe that the Pauli spectrum of random evolution can be approximated by two highly concentrated peaks which allows us to compute its SRE. Further, we introduce a class of random evolution that can be expressed as random Clifford circuits and rotations, where we provide its exact SRE. Our results opens up new approaches to characterize the complexity of quantum systems.

Quantum Physics,Statistical Mechanics
Some more results on relativized Chaitin's $Ω$

Liang Yu

2023-08-28

Abstract:We prove that, assuming $\mathrm{ZF}$, and restricted to any pointed set, Chaitin's $\Omega_U:x\mapsto \Omega_U^x=\sum_{U^x(\sigma)\downarrow}2^{-|\sigma|}$ is not injective for any universal prefix-free Turing machine $U$, and that $\Omega_U^x$ fails to be degree invariant in a very strong sense, answering several recent questions in descriptive set theory. Moreover, we show that under $\mathrm{ZF}+\mathrm{AD}$, every function $f$ mapping $x$ to $x$-random must be uncountable-to-one over an upper cone of Turing degrees.

Logic

On the computational power of $C$-random strings

Reductions to the set of random strings: The resource-bounded case

Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Effective Aspects of Algorithmically Random Structures

The Chvátal-Sankoff problem: Understanding random string comparison through stochastic processes

On Kolmogorov Structure Functions

The EL Theorem

The Ginsburg--Sands theorem and computability theory

The Kolmogorov Complexity of Random Reals

Undecidability in binary tag systems and the Post correspondence problem for four pairs of words

Power of Randomization in Automata on Infinite Strings

Representation Theory of Compact Metric Spaces and Computational Complexity of Continuous Data

A correspondence between the time and space complexity

Maximal Chains in the Turing Degrees

On the Computation of Distances for Probabilistic Context-Free Grammars

Computability in infinite Galois theory and algorithmically random algebraic fields

Computability Theory of Closed Timelike Curves

On Initial Segment Complexity and Degrees of Randomness

State Complexity of Binary Coded Regular Languages

Probing quantum complexity via universal saturation of stabilizer entropies

Some more results on relativized Chaitin's $Ω$