Kolmogorov Complexity Research Historical Review

Bernhard Hofmann-Wellenhof,Klaus Legat,Manfred Wieser

DOI: https://doi.org/10.3969/j.issn.1005-6408.2004.01.005

2004-01-01

Abstract:The bring and development context and meanings about Kolmogorov complexity have been mostly discussed.

What problem does this paper attempt to address?

Review the Logic Reconstructing Process of Kolmogorov's Complexity Research

吴彤,于金龙

DOI: https://doi.org/10.3969/j.issn.1000-8934.2003.09.016

2003-01-01

Abstract:This paper try to make A.N.Kolmogorov's logic development skeleton about animadverting and constructing on intuitionistic logic?information theory and probability theory, clearing and interpreting the concept of Kolmogorov's complexity and it's inevitability in the course of logic development.
Kolmogorov complexity as a hidden factor of scientific discourse: from Newton's law to data mining

Yuri I. Manin

DOI: https://doi.org/10.48550/arXiv.1301.0081

2013-01-01

Abstract:The word "complexity" is most often used as a meta--linguistic expression referring to certain intuitive characteristics of a natural system and/or its scientific description. These characteristics may include: sheer amount of data that must be taken into account; visible "chaotic" character of these data and/or space distribution/time evolution of a system etc. This talk is centered around the precise mathematical notion of "Kolmogorov complexity", originated in the early theoretical computer science and measuring the degree to which an available information can be compressed. In the first part, I will argue that a characteristic feature of basic scientific theories, from Ptolemy's epicycles to the Standard Model of elementary particles, is their splitting into two very distinct parts: the part of relatively small Kolmogorov complexity ("laws", "basic equations", "periodic table", "natural selection, genotypes, mutations") and another part, of indefinitely large Kolmogorov complexity ("initial and boundary conditions", "phenotypes", "populations"). The data constituting this latter part are obtained by planned observations, focussed experiments, and afterwards collected in growing databases (formerly known as "books", "tables", "encyclopaedias" etc). In this discussion Kolomogorov complexity plays a role of the central metaphor. The second part and Appendix 1 are dedicated to more precise definitions and examples of complexity.

History and Overview,History and Philosophy of Physics
Kolmogorov complexity in perspective

Marie Ferbus-Zanda,Serge Grigorieff

DOI: https://doi.org/10.48550/arXiv.0801.0354

2008-01-02

Abstract:We survey the diverse approaches to the notion of information content: from Shannon entropy to Kolmogorov complexity. The main applications of Kolmogorov complexity are presented namely, the mathematical notion of randomness (which goes back to the 60's with the work of Martin-Lof, Schnorr, Chaitin, Levin), and classification, which is a recent idea with provocative implementation by Vitanyi and Cilibrasi.

Logic,Computational Complexity,Information Theory
Kolmogorov complexity as a combinatorial tool

Alexander Shen

2024-05-15

Abstract:Kolmogorov complexity is often used as a convenient language for counting and/or probabilistic existence proofs. However, there are some applications where Kolmogorov complexity is used in a more subtle way. We provide one (somehow) surprising example where an existence of a winning strategy in a natural combinatorial game is proven (and no direct proof is known).

Discrete Mathematics,Information Theory,Combinatorics
Theory and Applications of Probabilistic Kolmogorov Complexity

Zhenjian Lu,Igor C. Oliveira

DOI: https://doi.org/10.48550/arXiv.2205.14718

2022-05-29

Computational Complexity

Abstract:Diverse applications of Kolmogorov complexity to learning [CIKK16], circuit complexity [OPS19], cryptography [LP20], average-case complexity [Hir21], and proof search [Kra22] have been discovered in recent years. Since the running time of algorithms is a key resource in these fields, it is crucial in the corresponding arguments to consider time-bounded variants of Kolmogorov complexity. While fruitful interactions between time-bounded Kolmogorov complexity and different areas of theoretical computer science have been known for quite a while (e.g., [Sip83, Ko91, ABK+06, AF09], to name a few), the aforementioned results have led to a renewed interest in this topic. The theory of Kolmogorov complexity is well understood, but many useful results and properties of Kolmogorov complexity are not known to hold in time-bounded settings. This creates technical difficulties or leads to conditional results when applying methods from time-bounded Kolmogorov complexity to algorithms and complexity theory. Perhaps even more importantly, in many cases it is necessary to consider randomised algorithms. Since random strings have high complexity, the classical theory of time-bounded Kolmogorov complexity might be inappropriate in such contexts. To mitigate these issues and develop a theory of time-bounded Kolmogorov complexity that survives in the setting of randomised computations, some recent papers [Oli19, LO21, LOS21, GKLO22, LOZ22] have explored probabilistic notions of time-bounded Kolmogorov complexity, such as $\mathsf{rKt}$ complexity [Oli19], $\mathsf{rK}^t$ complexity [LOS21], and $\mathsf{pK}^t$ complexity [GKLO22]. These measures consider different ways of encoding an object via a probabilistic representation. In this survey, we provide an introduction to probabilistic time-bounded Kolmogorov complexity and its applications, highlighting many open problems and research directions.
On Concepts of Complexities and Its Meaning in Research

吴彤

2004-01-01

Abstract:In this paper, we class and compare all kinds of complexities, and discuss the evolvement, characteristic, diversity and substance of complexity research at home and abroad. Complexity concepts can be based on the arithmetic complexity, and the complexity concepts can generally be distinguished as three kinds: the computation, the multiplicity, and the metaphor. There are inherent relations in them, computational complexities are a measurement of complexity about a set of strands in one dimension, complexities of structural diversity are a measurement of complexity between administrative levels, and metaphor complexities in their outside are a measurement of complexity that interactional relations between systems and its histories, its evolvements, its circumstance in greater context.
Is Complexity Randomness

WU Tong

DOI: https://doi.org/10.3969/j.issn.1005-6408.2005.02.002

2005-01-01

Abstract:Discussed and analysed some mistakes in understandin g Kolmogorov complexity, pointed out incompressibility not equal to disorder, and not equal to stochastic in trad ition, in some cases, even be in opposition. It is explained that Kolmogorov com plexity can become a measure for or der state of systems.
Kolmogorov complexity in the USSR (1975--1982): isolation and its end

V.V. V'yugin

DOI: https://doi.org/10.48550/arXiv.1907.05056

2019-07-11

Abstract:These reminiscences are about the "dark ages" of algorithmic information theory in the USSR. After a great interest in this topic in 1960s and the beginning of 1970s the number of people working in this area in the USSR decreased significantly. At that time L.A. Levin published a bunch of papers that were seminal for the modern algorithmic information theory. Then he left the USSR, and the new wave of interest was triggered by the talk of A.N. Kolmogorov at a Moscow State (Lomonosov) University Mathematical Department (Logic and Algorithms Division) seminar organized by him; several younger researchers obtained some new results in algorithmic information theory.

General Literature,Information Theory
Ideas Behind Kolmogorov Complexity and Related Kolmogorov's Ideas about The Physical Impossibility of Large Integers: How Their Formalization Can Help in Foundations of Physics

Isaak A. Kunin,Vladik Kreinovich,Yuri A. Kuperin

DOI: https://doi.org/10.48550/arXiv.physics/0105038

2001-05-14

Abstract:In addition to the equations, physicists use the following additional difficult-to-formalize property: that the initial conditions and the value of the parameters must not be abnormal. We will describe a natural formalization of this property, and show that this formalization in good accordance with theoretical physics. At present, this formalization has been mainly applied to the foundations of physics. However, potentially, more practical applications are possible.

General Physics
QUANTUM KOLMOGOROV COMPLEXITY AND ITS APPLICATIONS

CATERINA E. MORA,HANS J. BRIEGEL,BARBARA KRAUS

DOI: https://doi.org/10.1142/s0219749907003171

2007-10-01

International Journal of Quantum Information

Abstract:Kolmogorov complexity is a measure of the information contained in a binary string. We investigate here the notion of quantum Kolmogorov complexity, a measure of the information required to describe a quantum state. We show that for any definition of quantum Kolmogorov complexity measuring the number of classical bits required to describe a pure quantum state, there exists a pure n-qubit state which requires exponentially many bits of description. This is shown by relating the classical communication complexity to the quantum Kolmogorov complexity. Furthermore, we give some examples of how quantum Kolmogorov complexity can be applied to prove results in different fields, such as quantum computation and thermodynamics, and we generalize it to the case of mixed quantum states.

physics, particles & fields,quantum science & technology, mathematical,computer science, theory & methods
Is Randomness "Native" to Computer Science?

Marie Ferbus-Zanda,Serge Grigorieff

DOI: https://doi.org/10.48550/arXiv.0801.0289

2008-01-01

Abstract:We survey the Kolmogorov's approach to the notion of randomness through the Kolmogorov complexity theory. The original motivation of Kolmogorov was to give up a quantitative definition of information. In this theory, an object is randomness in the sense that it has a large information content. Afterwards, we present parts of the work of Martin-Lof, Schnorr, Chaitin and Levin which supply a mathematical notion of randomness throughout diverse theories from the the 60' up to recently.

Logic,Computational Complexity
A malware detection framework based on kolmogorov complexity

Wei Deng,Qiao Liu,Hongrong Cheng,Zhiguang Qin

2011-01-01

Journal of Computational Information Systems

Abstract:Malware has been posing a major threat for computer systems. The huge amount and diversity of its variants, such as computer viruses, Internet worms and Trojan horses, render classic security defenses ineffective. For the existence of active adversaries which constantly attempt to evade anti-malware, traditional signature-based approaches fail to detect malware which is new or obfuscated. This paper presents a general malware detection framework based on Kolmogorov complexity. As an example, we use a statistical data compression model which is Dynamic Markov Compression (DMC) to classify a code instance either as a "malware" or "benign" code instance. Our preliminary results are very promising. Our experimental results also demonstrate the framework can effectively detect unknown and obfuscated malware with high quality. © 2005 by Binary Information Press.
Kolmogorov Complexity and the Garden of Eden Theorem

Andrey Alpeev

DOI: https://doi.org/10.48550/arXiv.1212.1901

2012-12-09

Cellular Automata and Lattice Gases

Abstract:Suppose $\tau$ is a cellular automaton over an amenable group and a finite alphabet. Celebrated Garden of Eden theorem states, that pre-injectivity of $\tau$ is equivalent to non-existence of Garden of Eden configuration. In this paper we will prove, that imposing some mild restrictions, we could add another equivalent assertion: non-existence of Garden of Eden configuration is equivalent to preservation of asymptotic Kolmogorov complexity under the action of cellular automaton. It yields a characterisation of the cellular automata, which preserve the asymptotic Kolmogorov complexity.
A look at the Kolmogorov complexity of finite groupoids and algebras

Carles Cardó

2023-12-06

Abstract:The incompressibility method is a counting argument in the framework of algorithmic complexity that permits discovering properties that are satisfied by most objects of a class. This paper gives a preliminary insight into Kolmogorov's complexity of groupoids and some algebras. The incompressibility method shows that almost all the groupoids are asymmetric and simple: Only trivial or constant homomorphisms are possible. However, highly random groupoids allow subgroupoids with interesting restrictions that reveal intrinsic structural properties. We also study the issue of the algebraic varieties and wonder which equational identities allow randomness.

Information Theory
The origins and legacy of Kolmogorov's Grundbegriffe

Glenn Shafer,Vladimir Vovk

DOI: https://doi.org/10.48550/arXiv.1802.06071

2018-02-06

Abstract:April 25, 2003, marked the 100th anniversary of the birth of Andrei Nikolaevich Kolmogorov, the twentieth century's foremost contributor to the mathematical and philosophical foundations of probability. The year 2003 was also the 70th anniversary of the publication of Kolmogorov's Grundbegriffe der Wahrscheinlichkeitsrechnung. Kolmogorov's Grundbegriffe put probability's modern mathematical formalism in place. It also provided a philosophy of probability - an explanation of how the formalism can be connected to the world of experience. In this article, we examine the sources of these two aspects of the Grundbegriffe - the work of the earlier scholars whose ideas Kolmogorov synthesized.

History and Overview,Probability
Novel measures based on the Kolmogorov complexity for use in complex system behavior studies and time series analysis

Dragutin T. Mihailović,Gordan Mimić,Emilija Nikolić-Djorić,Ilija Arsenić

DOI: https://doi.org/10.1515/phys-2015-0001

2015-01-01

Open Physics

Abstract:Abstract We propose novel metrics based on the Kolmogorov complexity for use in complex system behavior studies and time series analysis. We consider the origins of the Kolmogorov complexity and discuss its physical meaning. To get better insights into the nature of complex systems and time series analysis we introduce three novel measures based on the Kolmogorov complexity: (i) the Kolmogorov complexity spectrum, (ii) the Kolmogorov complexity spectrum highest value and (iii) the overall Kolmogorov complexity. The characteristics of these measures have been tested using a generalized logistic equation. Finally, the proposed measures have been applied to different time series originating from: a model output (the biochemical substance exchange in a multi-cell system), four different geophysical phenomena (dynamics of: river flow, long term precipitation, indoor

physics, multidisciplinary
Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Shuichi Hirahara,Zhenjian Lu,Mikito Nanashima

2024-09-19

Abstract:The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to obtaining fundamental results in average-case complexity, yet whether any samplable distribution admits a coding theorem for randomized time-bounded Kolmogorov complexity ($\mathsf{rK}^\mathsf{poly}$) is open and a common bottleneck in the recent literature of meta-complexity. Previous works bypassed this issue by considering probabilistic Kolmogorov complexity ($\mathsf{pK}^\mathsf{poly}$), in which public random bits are assumed to be available. In this paper, we present an efficient coding theorem for randomized Kolmogorov complexity under the non-existence of one-way functions, thereby removing the common bottleneck. This enables us to prove $\mathsf{rK}^\mathsf{poly}$ counterparts of virtually all the average-case results that were proved only for $\mathsf{pK}^\mathsf{poly}$, and enables the resolution of the open problems of Hirahara, Ilango, Lu, Nanashima, and Oliveira (STOC'23) and Hirahara, Kabanets, Lu, and Oliveira (CCC'24). The key technical lemma is that any distribution whose next bits are efficiently predictable admits an efficient encoding and decoding scheme, which could be of independent interest to data compression.

Computational Complexity
Algorithmic Information Theory and Foundations of Probability

Alexander Shen

DOI: https://doi.org/10.48550/arXiv.0906.4411

2009-06-24

History and Overview

Abstract:The use of algorithmic information theory (Kolmogorov complexity theory) to explain the relation between mathematical probability theory and `real world' is discussed.
Kolmogorov Complexity and Solovay Functions

Laurent Bienvenu,Rod Downey

DOI: https://doi.org/10.48550/arXiv.0902.1041

2009-02-06

Abstract:Solovay proved that there exists a computable upper bound f of the prefix-free Kolmogorov complexity function K such that f (x) = K(x) for infinitely many x. In this paper, we consider the class of computable functions f such that K(x) <= f (x)+O(1) for all x and f (x) <= K(x) + O(1) for infinitely many x, which we call Solovay functions. We show that Solovay functions present interesting connections with randomness notions such as Martin-Löf randomness and K-triviality.

Computational Complexity,Information Theory,Logic
A Survey on Complexity Measures of Pseudo-Random Sequences

Chunlei Li

DOI: https://doi.org/10.3390/cryptography8020025

2024-07-29

Abstract:Since the introduction of the Kolmogorov complexity of binary sequences in the 1960s, there have been significant advancements in the topic of complexity measures for randomness assessment, which are of fundamental importance in theoretical computer science and of practical interest in cryptography. This survey reviews notable research from the past four decades on the linear, quadratic and maximum-order complexities of pseudo-random sequences and their relations with Lempel-Ziv complexity, expansion complexity, 2-adic complexity, and correlation measures.

Cryptography and Security

Kolmogorov Complexity Research Historical Review

Review the Logic Reconstructing Process of Kolmogorov's Complexity Research

Kolmogorov complexity as a hidden factor of scientific discourse: from Newton's law to data mining

Kolmogorov complexity in perspective

Kolmogorov complexity as a combinatorial tool

Theory and Applications of Probabilistic Kolmogorov Complexity

On Concepts of Complexities and Its Meaning in Research

Is Complexity Randomness

Kolmogorov complexity in the USSR (1975--1982): isolation and its end

Ideas Behind Kolmogorov Complexity and Related Kolmogorov's Ideas about The Physical Impossibility of Large Integers: How Their Formalization Can Help in Foundations of Physics

QUANTUM KOLMOGOROV COMPLEXITY AND ITS APPLICATIONS

Is Randomness "Native" to Computer Science?

A malware detection framework based on kolmogorov complexity

Kolmogorov Complexity and the Garden of Eden Theorem

A look at the Kolmogorov complexity of finite groupoids and algebras

The origins and legacy of Kolmogorov's Grundbegriffe

Novel measures based on the Kolmogorov complexity for use in complex system behavior studies and time series analysis

Optimal Coding for Randomized Kolmogorov Complexity and Its Applications

Algorithmic Information Theory and Foundations of Probability

Kolmogorov Complexity and Solovay Functions

A Survey on Complexity Measures of Pseudo-Random Sequences