A General Theory of Information and Computation

P.W. Adriaans

DOI: https://doi.org/10.48550/arXiv.1611.07829

2016-11-23

Abstract:This paper fills a gap in our understanding of the interaction between information and computation. It unifies other approaches to measuring information like Kolmogorov complexity and Shannon information. We define a theory about information flow in deterministic computing based on three fundamental observations: 1) Information is measured in logarithms, 2) All countable sets contain the same amount of information and 3) Deterministic computing does not create information. We analyze the flow of information through computational processes: exactly, for primitive recursive functions and elementary artithmetical operations and, under maximal entropy, for polynomial functions and diophantine equations. Thus we get, by the MRDP-theorem, a theory of flow of information for general computable functions. We prove some results like the Fueter-Pólya conjecture and the existence of an information conserving enumeration of all finite sets of numbers. We also show that the information flow in more complex derivatives of the primitive recursive functions like addition and multiplication is not trivial: in particular associativity is not information efficient for addition. Using the Cantor pairing function we develop a universal measuring device for partitions of the set of finite sets of numbers. We show that these sets can be enumerated by a polynomial function when ordered by cardinality, but not when ordered by their sums.

Information Theory

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to understand the interaction between information and computation and unify other methods of measuring information, such as Kolmogorov complexity and Shannon information. Specifically, the paper defines a theory about information flow in deterministic computation, based on three basic observations:

1. For all \(n\in\mathbb{N}\), the amount of information \(I(n)=\log n\) (information is measured logarithmically).
2. All countable sets contain the same amount of information.
3. For all \(x\), \(I(x)\geq I(f(x))\) (deterministic computation does not create information).

The paper analyzes the information flow through computational processes, especially the exact analysis of primitive recursive functions and basic arithmetic operations, as well as the analysis of polynomial functions and Diophantine equations under the condition of maximum entropy. Through the MRDP theorem, the paper provides a theory of information flow for general computable functions.

In addition, the paper also proves some results, such as the Fueter - Pólya conjecture and the existence of an information - preserving enumeration of all finite sets of numbers. The paper also shows that the information flow in operations (such as addition and multiplication) derived from more complex primitive recursive functions is not trivial, especially the associativity of addition does not hold in terms of information efficiency. Using the Cantor pairing function, the paper develops a general measurement tool for partitioning finite sets of numbers and shows that these sets can be enumerated by cardinality but not by their sum.

Overall, this paper aims to fill the gap in our understanding of the interaction between information and computation and proposes a unified theory of information measurement.