Turing Machines and Understanding Computational Complexity

P. M. B. Vitanyi

DOI: https://doi.org/10.48550/arXiv.1201.1223

2012-01-06

Abstract:We describe the Turing Machine, list some of its many influences on the theory of computation and complexity of computations, and illustrate its importance.

Computational Complexity

What problem does this paper attempt to address?

The Turing Computational Model

Juris Hartmanis,Stephen Cook,William Kahan,Richard Edwin Stearns,Andrew C. Yao

DOI: https://doi.org/10.1145/2322176.2322184

2012-01-01

Abstract:The panel presentations will discuss the beauty and simplicity of the Turing machine formulation of the previously elusive concept of computability and the intuitively satisfying explanation of the power and limitations of computability. They will also review how the Turing machine model provided simple proofs of deep results in logic, including Gödel’s incompleteness theorem. The panel will also examine specifi c results in computer science infl uenced by the Turing machine model as well as how it shaped the development of computational complexity theory. Quantum computing will be discussed and its relationship to the classic Turing machine model. The panel will also discuss what Alan Turing might say about the Inevitable Fallibility of Software.
Alan Turing and the Other Theory of Computation (Expanded)

Lenore Blum

DOI: https://doi.org/10.1017/cbo9781107338579.003

2014-01-01

Abstract:We recognize Alan Turing's work in the foundations of numerical computation (in particular, his 1948 paper "Rounding-Off Errors in Matrix Processes"), its influence in modern complexity theory, and how it helps provide a unifying concept for the two major traditions of the theory of computation.
Alan Turing and the Other Theory of Computation

Lenore Blum

DOI: https://doi.org/10.1145/2325296.2325299

2012-01-01

Abstract:The two major traditions of the Theory of Computation, each asking claim to similar motivations and aspirations, have for the most part run a parallel non-intersecting course. On one hand, we have the tradition arising from logic and computer science addressing problems with more recent origins, using tools of combinatorics and discrete mathematics. On the other hand, we have numerical analysis and scientific computation emanating from the classical tradition of equation solving and the continuous mathematics of calculus. Both traditions are motivated by a desire to understand the essence of computation, of algorithm; both aspire to discover useful, even profound, consequences. While the logic and computer science communities are keenly aware of Alan Turing's seminal role in the former (discrete) tradition of the theory of computation, most remain unaware of Alan Turing's role in the latter (continuous) tradition, this notwithstanding the many references to Turing in the modern numerical analysis/computational mathematics literature. In this talk I recognize Turing's work in the foundations of numerical computation. I also indicate its role in complexity theory today, and how it provides a unifying concept for the two major traditions in the Theory of Computation.
Stochastic Process Turing Machines

David Wolpert,Jordan Scharnhorst

2024-10-10

Abstract:Computer science theory provides many different measures of complexity of a system including Kolmogorov complexity, logical depth, computational depth, and Levin complexity. However, these measures are all defined only for deterministic Turing machines, i.e., deterministic dynamics of the underlying generative process whose output we are interested in. Therefore, by construction they cannot capture complexity of the output of stochastic processes - like those in the real world. Motivated by this observation, we combine probabilistic Turing machines with a prior over the inputs to the Turing machine to define a complete stochastic process of Turing machines. We call this a stochastic process Turing machine. Stochastic process Turing machines allow us to formalize a stochastic generalization of logical depth called stochastic depth, and also to apply stochastic thermodynamics to the analysis of Turing machines. Stochastic process Turing machines and stochastic depth allow us to study the complex, stochastic systems like the human brain, societies, and evolution all from within the framework of formal computation.

Computational Complexity,Formal Languages and Automata Theory,Logic in Computer Science
The NLP Engine: A Universal Turing Machine for NLP

Jiwei Li,Eduard Hovy

DOI: https://doi.org/10.48550/arxiv.1503.00168

2015-01-01

Abstract:It is commonly accepted that machine translation is a more complex task than part of speech tagging. But how much more complex? In this paper we make an attempt to develop a general framework and methodology for computing the informational and/or processing complexity of NLP applications and tasks. We define a universal framework akin to a Turning Machine that attempts to fit (most) NLP tasks into one paradigm. We calculate the complexities of various NLP tasks using measures of Shannon Entropy, and compare `simple' ones such as part of speech tagging to `complex' ones such as machine translation. This paper provides a first, though far from perfect, attempt to quantify NLP tasks under a uniform paradigm. We point out current deficiencies and suggest some avenues for fruitful research.
Incomputability after Alan Turing

S. Barry Cooper

DOI: https://doi.org/10.48550/arXiv.1304.6363

2013-04-23

Abstract:Incomputability as a mathematical notion arose from work of Alan Turing and Alonzo Church in the 1930s. Like Turing himself, it attracted less attention than it deserved beyond the confines of mathematics. Today our experiences in computer science, physics, biology, artificial intelligence, economics and the humanities point to the importance of the notion for understanding the world around us. This article takes a Turing centenary look at how the interface between the computable world and the incomputable formed a central theme in Turing's work - from the early establishment of the standard model of the stored program computer, to the late work on emergence of form in nature, and the first approaches to understanding and simulating human intelligence. Turing's thinking was remarkably prescient, and his legacy still impacts on much of our work. The incomputable may turn out to be a specially important part of the legacy, with consequences that Alan Turing himself could not have envisaged.

History and Overview,Computational Complexity,Logic in Computer Science
The Incomputable Alan Turing

S. Barry Cooper

DOI: https://doi.org/10.48550/arXiv.1206.1706

2012-06-08

Abstract:The last century saw dramatic challenges to the Laplacian predictability which had underpinned scientific research for around 300 years. Basic to this was Alan Turing's 1936 discovery (along with Alonzo Church) of the existence of unsolvable problems. This paper focuses on incomputability as a powerful theme in Turing's work and personal life, and examines its role in his evolving concept of machine intelligence. It also traces some of the ways in which important new developments are anticipated by Turing's ideas in logic.

Logic,History and Overview
Computability and analysis: the legacy of Alan Turing

Jeremy Avigad,Vasco Brattka

DOI: https://doi.org/10.1017/CBO9781107338579.002

2012-10-30

Abstract:We discuss the legacy of Alan Turing and his impact on computability and analysis.

Logic,Logic in Computer Science,History and Overview
Turing Automata and Graph Machines

Miklós Bartha

DOI: https://doi.org/10.4204/EPTCS.26.3

2010-06-08

Abstract:Indexed monoidal algebras are introduced as an equivalent structure for self-dual compact closed categories, and a coherence theorem is proved for the category of such algebras. Turing automata and Turing graph machines are defined by generalizing the classical Turing machine concept, so that the collection of such machines becomes an indexed monoidal algebra. On the analogy of the von Neumann data-flow computer architecture, Turing graph machines are proposed as potentially reversible low-level universal computational devices, and a truly reversible molecular size hardware model is presented as an example.

Formal Languages and Automata Theory,Discrete Mathematics
Some perspectives on computational complexity

Andrew Chi-Chih Yao

DOI: https://doi.org/10.1145/380752.380856

2001-01-01

Abstract:In past decades, the theory of computational complexity has flourished in terms of both the revelation of its internal structures and the unfolding of its numerous applications. In this paper we discuss several persistent and interwoven themes underlying many of these accomplishments. Chief among them are the interplay between communication and computation, the power of problem reduction, and the increasingly prominent role played by classical mathematics. We will also speculate on a few promising directions for future development of computational complexity.
Complexity Concepts for Combinatorial and Continuous Optimization Problems

Wenxun XING

DOI: https://doi.org/10.15960/j.cnki.issn.1007-6093.2017.02.005

2017-01-01

Abstract:Complexity concepts oriented from the theoretical Turing machine are widely accepted in study of combinatorial optimization problems.The polynomially computable and NP-hard concepts are frequently used in recent papers on continuous optimization problems.This paper presents a very brief introduction to show their relationship and difference used in the two fields.
A Thermodynamically Universal Turing Machine

Jihai Zhu

2023-07-07

Abstract:Expanding upon the widely recognized notion of mathematical universality in Turing machines, a concept of thermodynamic universality in Turing machines is introduced. Under the physical Church-Turing thesis, the existence of a thermodynamically universal Turing machine (TUTM) is demonstrated. A TUTM not only has the capability to simulate the input-output behavior of any given Turing machine but also replicate the heat production of that machine up to an additive constant. The finding shows that the hypothesis that the physical world is simulated by Turing machines may not be completely absurd.

Computational Complexity,Statistical Mechanics
Beyond Turing Machines

Kurt Ammon

DOI: https://doi.org/10.48550/arXiv.0907.4100

2009-07-23

Abstract:This paper discusses "computational" systems capable of "computing" functions not computable by predefined Turing machines if the systems are not isolated from their environment. Roughly speaking, these systems can change their finite descriptions by interacting with their environment.

Artificial Intelligence
Characterisations of Variant Transfinite Computational Models: Infinite Time Turing, Ordinal Time Turing, and Blum-Shub-Smale machines

Philip Welch

DOI: https://doi.org/10.48550/arXiv.2012.08001

2020-12-15

Abstract:We consider how changes in transfinite machine architecture can sometimes alter substantially their capabilities. We approach the subject by answering three open problems touching on: firstly differing halting time considerations for machines with multiple as opposed to single heads, secondly space requirements, and lastly limit rules. We: 1) use admissibility theory, $\Sigma_{2}$-codes and $\Pi_{3}$-reflection properties in the constructible hierarchy to classify the halting times of ITTMs with multiple independent heads; the same for Ordinal Turing Machines which have $\tmop{On}$ length tapes; 2) determine which admissible lengths of tapes for transfinite time machines with long tapes allow the machine to address each of their cells - a question raised by B. Rin; 3) characterise exactly the strength and behaviour of transfinitely acting Blum-Shub-Smale machines using a $\tmop{Liminf}$ rule on their registers - thereby establishing there is a universal such machine. This is in contradistinction to the machine using a `continuity' rule which fails to be universal.

Logic
More Comprehensive Computational Number Theory

Tianxin Cai

DOI: https://doi.org/10.4172/2168-9679.1000e102

2012-01-01

Journal of Applied & Computational Mathematics

Abstract:Computational number theory, also known as algorithmic number theory, is the study of algorithms for performing number theoretic computations. The best known problem in the field is the integer factorization, the great common divisor or the least common multiple. The largest known primes, which are usually Mersenne primes, and they were usually found by GIMPS, the Great Internet Mersenne Prime Search.
Multiway Turing Machines

Stephen Wolfram

DOI: https://doi.org/10.48550/arXiv.2103.04961

2021-03-09

Abstract:Multiway Turing machines (also known as nondeterministic Turing machines or NDTMs) with explicit, simple rules are studied. Even very simple rules are found to generate complex behavior, characterized by complex multiway graphs, that can be visualized in multispace that combines "tape" and branchial space. The threshold for complex behavior appears to be machines with just s = 1 head states, k = 2 tape colors and p = 3 possible cases, and such machines may potentially be universal. Other characteristics of multiway Turing machines are also studied, including causal invariance, cyclic tapes and generalized busy beaver problems. Multiway Turing machines provide minimal examples of a variety of issues encountered in both concurrent computing and the theory of observers in quantum mechanics, especially in our recent models of physics.

Logic in Computer Science,Computational Complexity,Discrete Mathematics
Turing Compute Model for Non-negative Binary Numbers.

Wenyu Chen,Xiaobin Wang,Xiaoou Cheng,Shixin Sun

DOI: https://doi.org/10.4304/jsw.5.1.123-130

2010-01-01

Journal of Software

Abstract:Turing-computable issue is important in research of Turing Machine and has significant value in both theory and practice. The paper analyzes Turing-computable issue of non-negative numbers by relational operations(includes greater than, less than and equal) and arithmetic operations(includes add operation, subtract, multiply, divide and modulo). The regulation of computing 1-bit binary number and the carry set(or borrow set) are defined to compute multi-bit binary numbers. Algorithms are described through multi-tape Turing machine. For some operations, the discussion is extended to base-N number system(3≤N≤10). Turing regulation for add operation is used to implement the Turing counter for counting the length of the string on the input tape of the Turing machine.
Set Turing Machines

Garvin Melles

DOI: https://doi.org/10.48550/arXiv.2103.14013

2021-03-26

Abstract:We define a generalization of the Turing machine that computes on general sets. Our main theorem states that the class of generalized Turing machine computable functions and the class of Set Recursive functions coincide.

Logic,Logic in Computer Science
An Invitation to Universality in Physics, Computer Science, and Beyond

Tomáš Gonda,Gemma De les Coves

2024-06-24

Abstract:A universal Turing machine is a powerful concept - a single device can compute any function that is computable. A universal spin model, similarly, is a class of physical systems whose low energy behavior simulates that of any spin system. Our categorical framework for universality (<a class="link-https" data-arxiv-id="2307.06851" href="https://arxiv.org/abs/2307.06851">arXiv:2307.06851</a>) captures these and other examples of universality as instances. In this article, we present an accessible account thereof with a focus on its basic ingredients and ways to use it. Specifically, we show how to identify necessary conditions for universality, compare types of universality within each instance, and establish that universality and negation give rise to unreachability (such as uncomputability).

Computational Complexity,Formal Languages and Automata Theory,Mathematical Physics
On the Dynamic Qualitative Behaviour of Universal Computation

Hector Zenil

DOI: https://doi.org/10.48550/arXiv.1201.0824

2012-01-04

Abstract:We explore the possible connections between the dynamic behaviour of a system and Turing universality in terms of the system's ability to (effectively) transmit and manipulate information. Some arguments will be provided using a defined compression-based transition coefficient which quantifies the sensitivity of a system to being programmed. In the same spirit, a list of conjectures concerning the ability of Busy Beaver Turing machines to perform universal computation will be formulated. The main working hypothesis is that universality is deeply connected to the qualitative behaviour of a system, particularly to its ability to react to external stimulus--as it needs to be programmed--and to its capacity for transmitting this information.

Computational Complexity,Dynamical Systems,Cellular Automata and Lattice Gases

Turing Machines and Understanding Computational Complexity

The Turing Computational Model

Alan Turing and the Other Theory of Computation (Expanded)

Alan Turing and the Other Theory of Computation

Stochastic Process Turing Machines

The NLP Engine: A Universal Turing Machine for NLP

Incomputability after Alan Turing

The Incomputable Alan Turing

Computability and analysis: the legacy of Alan Turing

Turing Automata and Graph Machines

Some perspectives on computational complexity

Complexity Concepts for Combinatorial and Continuous Optimization Problems

A Thermodynamically Universal Turing Machine

Beyond Turing Machines

Characterisations of Variant Transfinite Computational Models: Infinite Time Turing, Ordinal Time Turing, and Blum-Shub-Smale machines

More Comprehensive Computational Number Theory

Multiway Turing Machines

Turing Compute Model for Non-negative Binary Numbers.

Set Turing Machines

An Invitation to Universality in Physics, Computer Science, and Beyond

On the Dynamic Qualitative Behaviour of Universal Computation