The Randomness Deficiency Function and the Shift Operator

Samuel Epstein

2024-08-27

Abstract:Almost surely, the difference between the randomness deficiencies of two infinite sequences will be unbounded with respect to repeated iterations of the shift operator.

Computational Complexity

What problem does this paper attempt to address?

The Shift Bound for Abelian Codes and Generalizations of the Donoho-Stark Uncertainty Principle

Tao Feng,Henk D. L. Hollmann,Qing Xiang

DOI: https://doi.org/10.1109/tit.2019.2906301

IF: 2.5

2019-01-01

IEEE Transactions on Information Theory

Abstract:Let G be a finite abelian group. If f : G -> C is a nonzero function with Fourier transform f, the Donoho-Stark uncertainty principle states that |supp( f)||supp((f) over cap)| >= |G|. The purpose of this paper is twofold. First, we present the shift bound for abelian codes with a streamlined proof. Second, we use the shifting technique to prove a generalization and a sharpening of the Donoho-Stark uncertainty principle. In particular, if f : G -> F is a non-zero function from G to a field F, and if f has a Fourier transform (f) over cap, the sharpened uncertainty principle states that |supp(f)|| supp((f) over cap)| >= | G|+| supp(f)|-| H(supp(f))|, where H(supp(f)) is the stabilizer of supp(f) in G.
On Increments of Sums of Random-Variables Without Moment Hypotheses

ZY LIN

DOI: https://doi.org/10.1360/ya1990-33-9-1047

1990-01-01

Abstract:> The a. s. limiting behavior of increments of partial sums for a sequence of random variables has been discussed by many authors. A series of fine and elegant results have been obtained. However, up to now, the results of this kind have all required the existence of moments. In this paper we try to drop this condition. The existing results with moment conditions become special cases of our theorems.
ON THE FLUCTUATION IN THE RANDOM ASSIGNMENT PROBLEM

Sung-Chul Lee,Zhong-Gen Su

DOI: https://doi.org/10.4134/ckms.2002.17.2.321

2002-01-01

Communications of the Korean Mathematical Society

Abstract:Consider the random assignment (or bipartite matching) problem with iid uniform edge costs t(i, j). Let $A_{n}$ be the optimal assignment cost. Just recently does Aldous [2] give a rigorous proof that E $A_{n}$ longrightarrowζ(2). In this paper we establish the upper and lower bounds for Var $A_{n}$ , i.e., there exist two strictly positive but finite constants $C_1$ and $C_2$ such athat $C_1$ $n^{(-5}$2)/ (log n)$^{(-3}$2)/ $\leq$ Var $A_{n}$ $\leq$ $C_2$ $n^{-1}$ (log n)$^2$.EX>.
Entropy and Independence in Symbolic Dynamics

Marcin Kulczycki,Dominik Kwietniak,Jian Li

2014-01-01

Abstract:We introduce a new family of shift spaces — the subordinate shifts.Using them we prove in an elementary way that for every nonnegative realnumber t one can ﬁnd a shift space with entropy t. Moreover, we showthat there is a connection between positive entropy and combinatorial in-dependence of a shift space. Positive entropy can be characterized throughexistence of a large (in terms of asymptotic and Shnirelman densities) setof coordinates along which the highest possible degree of randomness inpoints from the shift is observed. 1 Introduction. A full shift over a ﬁnite set Ais the set A N of all inﬁnite sequences of elementsof A. A shift space is a subset of A N deﬁned by constraints on the ﬁnite-length blocks that are allowed to appear as subsequences. Shift spaces aremathematical models for digitized information. They arise frequently as a resultof a discretization of dynamical processes. The shift map, which discards theﬁrst element of a sequence and shifts the remaining ones by one place to theleft, turns every shift space into a dynamical system.Certain shift spaces share a structure similar to each other to the point thatthey may be treated as virtually the same. For example, there is neither lossnor gain of information when the full {0,1}-shift is transformed into the full{4,7}-shift by switching every 0 to 4 and every 1 to 7. These two full shiftsare an example of conjugate shift spaces. Roughly speaking, two shift spacesare conjugate if there is a conjugacy, that is, a special invertible map betweenthese spaces, which commutes with the shift map. Conjugate shift spaces canbe treated as two instances of the same underlying object as the conjugacytransfers one onto the other (we refer the reader to [9, Def. 1.5.9] for moredetails). This leads to the conjugacy problem, which is a question whether twogiven shift spaces are equivalent under such an invertible encoding. An invariantof conjugacy is a property associated to a shift space that is preserved under thisencoding. Among the most important invariants is entropy, which is a measureof complexity of the shift space X. Entropy is a single nonnegative real numberh(X) which measures the asymptotic growth rate of the number of blocks thatoccur as subsequences of points in X.1
Randomness and lowness notions via open covers

Laurent Bienvenu,Joseph S. Miller

DOI: https://doi.org/10.48550/arXiv.1303.4902

2013-03-20

Abstract:One of the main lines of research in algorithmic randomness is that of lowness notions. Given a randomness notion R, we ask for which sequences A does relativization to A leave R unchanged (i.e., R^A = R)? Such sequences are call low for R. This question extends to a pair of randomness notions R and S, where S is weaker: for which A is S^A still weaker than R? In the last few years, many results have characterized the sequences that are low for randomness by their low computational strength. A few results have also given measure-theoretic characterizations of low sequences. For example, Kjos-Hanssen proved that A is low for Martin-Löf randomness if and only if every A-c.e. open set of measure less than 1 can be covered by a c.e. open set of measure less than 1. In this paper, we give a series of results showing that a wide variety of lowness notions can be expressed in a similar way, i.e., via the ability to cover open sets of a certain type by open sets of some other type. This provides a unified framework that clarifies the study of lowness for randomness notions, and allows us to give simple proofs of a number of known results. We also use this framework to prove new results, including showing that the classes Low(MLR;SR) and Low(W2R;SR) coincide, answering a question of Nies. Other applications include characterizations of highness notions, a broadly applicable explanation for why low for randomness is the same as low for tests, and a simple proof that Low(W2R;S)=Low(MLR;S), where S is the class of Martin-Löf, computable, or Schnorr random sequences. The final section gives characterizations of lowness notions using summable functions and convergent measure machines instead of open covers. We finish with a simple proof of a result of Nies, that Low(MLR) = Low(MLR; CR).

Logic
Predictability and Randomness

Lenhart K. Schubert

2024-01-24

Abstract:Algorithmic theories of randomness can be related to theories of probabilistic sequence prediction through the notion of a predictor, defined as a function which supplies lower bounds on initial-segment probabilities of infinite sequences. An infinite binary sequence $z$ is called unpredictable iff its initial-segment "redundancy" $n+\log p(z(n))$ remains sufficiently low relative to every effective predictor $p$. A predictor which maximizes the initial-segment redundancy of a sequence is called optimal for that sequence. It turns out that a sequence is random iff it is unpredictable. More generally, a sequence is random relative to an arbitrary computable distribution iff the distribution is itself an optimal predictor for the sequence. Here "random" can be taken in the sense of Martin-Löf by using weak criteria of effectiveness, or in the sense of Schnorr by using stronger criteria of effectiveness. Under the weaker criteria of effectiveness it is possible to construct a universal predictor which is optimal for all infinite sequences. This predictor assigns nonvanishing limit probabilities precisely to the recursive sequences. Under the stronger criteria of effectiveness it is possible to establish a law of large numbers for sequences random relative to a computable distribution, which may be useful as a criterion of "rationality" for methods of probabilistic prediction. A remarkable feature of effective predictors is the fact that they are expressible in the special form first proposed by Solomonoff. In this form sequence prediction reduces to assigning high probabilities to initial segments with short and/or numerous encodings. This fact provides the link between theories of randomness and Solomonoff's theory of prediction.

Information Theory
Randomness extraction in computability theory

Douglas Cenzer,Christopher P. Porter

DOI: https://doi.org/10.48550/arXiv.2103.03971

2021-03-06

Abstract:In this article, we study a notion of the extraction rate of Turing functionals that translate between notions of randomness with respect to different underlying probability measures. We analyze several classes of extraction procedures: a first class that generalizes von Neumann's trick for extracting unbiased randomness from the tosses of a biased coin, a second class based on work of generating biased randomness from unbiased randomness by Knuth and Yao, and a third class independently developed by Levin and Kautz that generalizes the data compression technique of arithmetic coding. For the first two classes of extraction procedures, we identify a level of algorithmic randomness for an input that guarantees that we attain the extraction rate along that input, while for the third class, we calculate the rate attained along sufficiently random input sequences.

Logic
Random rearrangements and operators

Evgueni M. Semenov,Stephen J. Montgomery-Smith

DOI: https://doi.org/10.48550/arXiv.math/9704213

1999-12-04

Abstract:Consider an n by n matrix x_ij, and consider the quantity || x_{i,pi(i)} ||_X where X is a symmetric sequence space as a random variable where the permutation pi is chosen randomly. This was considered by Kwapien and Schutt, and we extend their results to rearrangement invariant spaces. We also consider the property of D and D^* convexity for rearrangement invariant spaces.

Functional Analysis,Probability
Longest common substring for random subshifts of finite type

Jerome Rousseau

2020-11-24

Abstract:In this paper, we study the behaviour of the longest common substring for random subshifts of finite type (for dynamicists) or of the longest common substring for random sequences in random environments (for probabilists). We prove that, under some exponential mixing assumptions, this behaviour is linked to the Rényi entropy of the stationary measure. We emphasize that what we establish is a quenched result.

Probability
The one-sided cycle shuffles in the symmetric group algebra

Darij Grinberg,Nadia Lafrenière

DOI: https://doi.org/10.5802/alco.346

2024-03-11

Abstract:We study a family of shuffling operators on the symmetric group $S_n$, which includes the top-to-random shuffle. The general shuffling scheme consists of removing one card at a time from the deck (according to some probability distribution) and re-inserting it at a (uniformly) random position further below. Rewritten in terms of the group algebra $\mathbb{R}[S_n]$, our shuffle corresponds to right multiplication by a linear combination of the elements \[t_i:=\text{cyc}_{i}+\text{cyc}_{i,i+1}+\text{cyc}_{i,i+1,i+2}+\cdots+\text{cyc}_{i,i+1,\ldots,n}\in \mathbb{R}[S_n]\] for all $i\in\{1,2,\ldots,n\}$ (where $\text{cyc}_{j_1,j_2,\ldots,j_p}$ stands for a $p$-cycle). We compute the eigenvalues of these shuffling operators and of all their linear combinations. In particular, we show that the eigenvalues of right multiplication by a linear combination $\lambda_1t_1+\lambda_2t_2+\cdots+\lambda_nt_n$ are the numbers $\lambda_1m_{I,1}+\lambda_2m_{I,2}+\cdots+\lambda_nm_{I,n}$, where $I$ ranges over the subsets of $\{1,2,\ldots,n-1\}$ that contain no two consecutive integers; here $m_{I,i}$ are certain integers. We compute the multiplicities of these eigenvalues and show that if they are all distinct, the shuffling operator is diagonalizable. To this purpose, we show that the operators of right multiplication by $t_1,t_2,\ldots,t_n$ on $\mathbb{R}[S_n]$ are simultaneously triangularizable (via a combinatorially defined basis). The results stated here over $\mathbb{R}$ for convenience are actually stated and proved over an arbitrary commutative ring $\mathbf{k}$. We finish by describing a strong stationary time for the random-to-below shuffle, which is the shuffle in which the card that moves below is selected uniformly at random, and we give the waiting time for this event to happen.

Combinatorics,Group Theory,Probability,Representation Theory
Randomness of D Sequences via Diehard Testing

James Bellamy

DOI: https://doi.org/10.48550/arXiv.1312.3618

2013-12-13

Abstract:This paper presents a comparison of the quality of randomness of D sequences based on diehard tests. Since D sequences can model any random sequence, this comparison is of value beyond this specific class.

Numerical Analysis
Large deviations of return times and related entropy estimators on shift spaces

Noé Cuneo,Renaud Raquépas

2024-05-22

Abstract:We prove the large deviation principle for several entropy and cross entropy estimators based on return times and waiting times on shift spaces over finite alphabets. We consider shift-invariant probability measures satisfying some decoupling conditions which imply no form of mixing nor ergodicity. We establish precise relations between the rate functions of the different estimators, and between these rate functions and the corresponding pressures, one of which is the Rényi entropy function. For the most commonly used definition of return times, the large-deviation rate function is proved to be nonconvex, except in marginal cases. The results apply in particular to irreducible Markov chains, equilibrium measures for Bowen-regular potentials, g-measures, invariant Gibbs states for absolutely summable interactions in statistical mechanics, and also to probability measures which may be far from Gibbsian, including some hidden Markov models and repeated quantum measurement processes.

Probability,Mathematical Physics,Dynamical Systems
The Infinity of Randomness

Yongxin Li

DOI: https://doi.org/10.48550/arXiv.2211.16975

2022-11-16

General Mathematics

Abstract:This work starts from definition of randomness, the results of algorithmic randomness are analyzed from the perspective of application. Then, the source and nature of randomness is explored, and the relationship between infinity and randomness is found. The properties of randomness are summarized from the perspective of interaction between systems, that is, the set composed of sequences generated by randomness has the property of asymptotic completeness. Finally, the importance of randomness in AI research is emphasized.
On Initial Segment Complexity and Degrees of Randomness

Joseph S. Miller,Liang Yu

DOI: https://doi.org/10.1090/s0002-9947-08-04395-x

IF: 1.3529

2008-01-01

Transactions of the American Mathematical Society

Abstract:One approach to understanding the. ne structure of initial segment complexity was introduced by Downey, Hirschfeldt and LaForte. They define X <=(K) Y to mean that (for all n) K( X vertical bar n) <= K(Y vertical bar n) + O( 1). The equivalence classes under this relation are the K-degrees. We prove that if X circle plus Y is 1-random, then X and Y have no upper bound in the K-degrees (hence, no join). We also prove that n-randomness is closed upward in the K-degrees. Our main tool is another structure intended to measure the degree of randomness of real numbers: the nu L-degrees. Unlike the K-degrees, many basic properties of the nu L-degrees are easy to prove. We show that X <=(K) Y implies X <=(nu L) Y, so some results can be transferred. The reverse implication is proved to fail. The same analysis is also done for <=(C), the analogue of <=(K) for plain Kolmogorov complexity.Two other interesting results are included. First, we prove that for any Z is an element of 2(omega), a 1-random real computable from a 1-Z-random real is automatically 1-Z-random. Second, we give a plain Kolmogorov complexity characterization of 1-randomness. This characterization is related to our proof that X <=(C) Y implies X <=(nu L) Y.
Ergodic optimization for continuous functions on non-Markov shifts

Mao Shinoda,Hiroki Takahasi,Kenichiro Yamamoto

2024-06-08

Abstract:Ergodic optimization aims to describe dynamically invariant probability measures that maximize the integral of a given function. For a wide class of intrinsically ergodic subshifts over a finite alphabet, we show that the space of continuous functions on the shift space splits into two subsets: one is a $G_\delta$ dense set for which all maximizing measures have `relatively small' entropy; the other is contained in the closure of the set of functions having uncountably many, fully supported ergodic measures with `relatively large' entropy. This result considerably generalizes and unifies the results of Morris (2010) and Shinoda (2018), and applies to a wide class of intrinsically ergodic non-Markov symbolic dynamics without Bowen's specification property, including any transitive piecewise monotonic interval map, some coded shifts and multidimensional $\beta$-transformations. Along with these examples of application, we provide an example of an intrinsically ergodic subshift with positive obstruction entropy to specification.

Dynamical Systems
Probabilistic vs deterministic gamblers

Laurent Bienvenu,Valentino Delle Rose,Tomasz Steifer

DOI: https://doi.org/10.48550/arXiv.2112.04460

2021-12-09

Abstract:Can a probabilistic gambler get arbitrarily rich when all deterministic gamblers fail? We study this problem in the context of algorithmic randomness, introducing a new notion -- almost everywhere computable randomness. A binary sequence $X$ is a.e.\ computably random if there is no probabilistic computable strategy which is total and succeeds on $X$ for positive measure of oracles. Using the fireworks technique we construct a sequence which is partial computably random but not a.e.\ computably random. We also prove the separation between a.e.\ computable randomness and partial computable randomness, which happens exactly in the uniformly almost everywhere dominating Turing degrees.

Logic
Hardness vs. Randomness, Revised: Uniform, Non-Black-Box, and Instance-wise

Lijie Chen,Roei Tell

DOI: https://doi.org/10.1137/22m1475491

2024-12-05

SIAM Journal on Computing

Abstract:SIAM Journal on Computing, Ahead of Print. We propose a new approach to the hardness-to-randomness framework and to the [math] conjecture. Classical results rely on nonuniform hardness assumptions to construct derandomization algorithms that work in the worst case, or rely on uniform hardness assumptions to construct derandomization algorithms that work only in the average case. In both types of results, the derandomization algorithm is "black-box" and uses the standard approach based on pseudorandom generators (PRGs). In this work we present results that closely relate new and natural uniform hardness assumptions to worst-case derandomization of [math], where the algorithms underlying the latter derandomization are non-black-box. In our main result, we show that [math] if the following holds: There exists a multi-output function computable by logspace-uniform circuits of polynomial size and depth [math] that cannot be computed by uniform probabilistic algorithms in time [math], for some universal constant [math], on almost all inputs. The required failure on "almost all inputs" is stronger than the standard requirement of failing on one input of each length; however, the same assumption without the depth restriction on [math] is necessary for the conclusion. This suggests a potential equivalence between worst-case derandomization of [math] of any form (i.e., not necessarily by a black-box algorithm) and the existence of efficiently computable functions that are hard for probabilistic algorithms on almost all inputs. In our second result, we introduce a new and uniform hardness-to-randomness tradeoff for the setting of superfast average-case derandomization; prior to this work, superfast average-case derandomization was known only under nonuniform hardness assumptions. In an extreme instantiation of our new tradeoff, under appealing uniform hardness assumptions and if one-way functions exist, we show that for every polynomial [math] and constant [math] it holds that [math], where the "[math]" prefix means that no polynomial-time algorithm can find, with nonnegligible probability, an input on which the deterministic simulation errs. Technically, our approach is to design targeted PRGs and hitting-set generators (HSGs), as introduced by Goldreich [In a world of [math], in Studies in Complexity and Cryptography, Lecture Notes in Comput. Sci. 6650, Springer, 2011, pp. 191–232]. Our targeted PRGs/HSGs "produce randomness from the input," as suggested by Goldreich and Wigderson [Proceedings of the 6th International Workshop on Randomization and Approximation Techniques in Computer Science (RANDOM), 2002, pp. 209–223], and our analysis of these targeted PRGs/HSGs relies on non-black-box versions of the reconstruction procedure of Impagliazzo and Wigderson [Proceedings of the 39th Annual IEEE Symposium on Foundations of Computer Science (FOCS), 1998, pp. 734–743]. Our main reconstruction procedure crucially relies on the ideas underlying the proof system of Goldwasser, Kalai, and Rothblum [J. ACM, 62 (2015), 27].

computer science, theory & methods,mathematics, applied
A negative dependence framework to assess different forms of scrambling

Henri Faure,Gracia Y. Dong,Christiane Lemieux

DOI: https://doi.org/10.48550/arXiv.2209.02013

2022-09-05

Abstract:We use the framework of dependence to assess the benefits of scrambling randomly versus deterministically for Faure and Halton sequences. We attempt to answer the following questions: when a deterministic sequence has known defects for small sample sizes, should we address these defects by applying random scrambling or should we find a "good" deterministic scrambling yielding a sequence that can then be randomized using a less computer-intensive randomization method such as a digital shift? And in the latter case, how do we choose a deterministic scrambling and how do we assess whether it is good or not?

Computation
On a probabilistic extension of the Oldenburger–Kolakoski sequence

Chloé Boison,Damien Jamet,Irène Marcovici

DOI: https://doi.org/10.1051/ita/2024005

2024-03-27

RAIRO - Theoretical Informatics and Applications

Abstract:The Oldenburger–Kolakoski sequence is the only infinite sequence over the alphabet {1, 2} that starts with 1 and is its own run-length encoding. In the present work, we take a step back from this largely known and studied sequence by introducing some randomness in the choice of the letters written. This enables us to provide some results on the convergence of the density of 1's in the resulting sequence. When the choice of the letters is given by an infinite sequence of i.i.d. random variables or by a Markov chain, the average densities of letters converge. Moreover, in the case of i.i.d. random variables, we are able to prove that the densities even almost surely converge.

computer science, theory & methods,mathematics, applied
Cutoff for the Biased Random Transposition Shuffle

Evita Nestoridi,Alan Yan

2024-09-25

Abstract:In this paper, we study the biased random transposition shuffle, a natural generalization of the classical random transposition shuffle studied by Diaconis and Shahshahani. We diagonalize the transition matrix of the shuffle and use these eigenvalues to prove that the shuffle exhibits total variation cutoff at time $t_N = \frac{1}{2b} N \log N$ with window $N$. We also prove that the limiting distribution of the number of fixed cards near the cutoff time is Poisson.

Probability,Combinatorics

The Randomness Deficiency Function and the Shift Operator

The Shift Bound for Abelian Codes and Generalizations of the Donoho-Stark Uncertainty Principle

On Increments of Sums of Random-Variables Without Moment Hypotheses

ON THE FLUCTUATION IN THE RANDOM ASSIGNMENT PROBLEM

Entropy and Independence in Symbolic Dynamics

Randomness and lowness notions via open covers

Predictability and Randomness

Randomness extraction in computability theory

Random rearrangements and operators

Longest common substring for random subshifts of finite type

The one-sided cycle shuffles in the symmetric group algebra

Randomness of D Sequences via Diehard Testing

Large deviations of return times and related entropy estimators on shift spaces

The Infinity of Randomness

On Initial Segment Complexity and Degrees of Randomness

Ergodic optimization for continuous functions on non-Markov shifts

Probabilistic vs deterministic gamblers

Hardness vs. Randomness, Revised: Uniform, Non-Black-Box, and Instance-wise

A negative dependence framework to assess different forms of scrambling

On a probabilistic extension of the Oldenburger–Kolakoski sequence

Cutoff for the Biased Random Transposition Shuffle