Entropy and Independence in Symbolic Dynamics
Marcin Kulczycki,Dominik Kwietniak,Jian Li
2014-01-01
Abstract:We introduce a new family of shift spaces — the subordinate shifts.Using them we prove in an elementary way that for every nonnegative realnumber t one can find a shift space with entropy t. Moreover, we showthat there is a connection between positive entropy and combinatorial in-dependence of a shift space. Positive entropy can be characterized throughexistence of a large (in terms of asymptotic and Shnirelman densities) setof coordinates along which the highest possible degree of randomness inpoints from the shift is observed. 1 Introduction. A full shift over a finite set Ais the set A N of all infinite sequences of elementsof A. A shift space is a subset of A N defined by constraints on the finite-length blocks that are allowed to appear as subsequences. Shift spaces aremathematical models for digitized information. They arise frequently as a resultof a discretization of dynamical processes. The shift map, which discards thefirst element of a sequence and shifts the remaining ones by one place to theleft, turns every shift space into a dynamical system.Certain shift spaces share a structure similar to each other to the point thatthey may be treated as virtually the same. For example, there is neither lossnor gain of information when the full {0,1}-shift is transformed into the full{4,7}-shift by switching every 0 to 4 and every 1 to 7. These two full shiftsare an example of conjugate shift spaces. Roughly speaking, two shift spacesare conjugate if there is a conjugacy, that is, a special invertible map betweenthese spaces, which commutes with the shift map. Conjugate shift spaces canbe treated as two instances of the same underlying object as the conjugacytransfers one onto the other (we refer the reader to [9, Def. 1.5.9] for moredetails). This leads to the conjugacy problem, which is a question whether twogiven shift spaces are equivalent under such an invertible encoding. An invariantof conjugacy is a property associated to a shift space that is preserved under thisencoding. Among the most important invariants is entropy, which is a measureof complexity of the shift space X. Entropy is a single nonnegative real numberh(X) which measures the asymptotic growth rate of the number of blocks thatoccur as subsequences of points in X.1