Time, Space, and Energy in Reversible Computing

Paul Vitanyi

DOI: https://doi.org/10.48550/arXiv.cs/0504088

2005-04-20

Computational Complexity

Abstract:We survey results of a quarter century of work on computation by reversible general-purpose computers (in this setting Turing machines), and general reversible simulation of irreversible computations, with respect to energy-, time- and space requirements.

What problem does this paper attempt to address?

Generalized Reversible Computing

Michael P. Frank

DOI: https://doi.org/10.48550/arXiv.1806.10183

2018-06-27

Abstract:Landauer's Principle that information loss from a computation implies entropy increase can be rigorously proved from mathematical physics. However, carefully examining its detailed formulation reveals that the traditional identification of logically reversible computational operations with bijective transformations of the full digital state space is actually not the correct logical-level characterization of the full set of classical computational operations that can be carried out physically with asymptotically zero energy dissipation. To find the correct logical conditions for physical reversibility, we must account for initial-state probabilities when applying the Principle. The minimal logical-level requirement for the physical reversibility of deterministic computational operations is that the subset of initial states that exhibit nonzero probability in a given statistical operating context must be transformed one-to-one into final states. Thus, any computational operation is conditionally reversible relative to any sufficiently-restrictive precondition on its initial state, and the minimum dissipation required for any deterministic operation by Landauer's Principle asymptotically approaches 0 when the probability of meeting any preselected one of its suitable preconditions approaches 1. This realization facilitates simpler designs for asymptotically thermodynamically reversible computational hardware, compared to designs that are restricted to using only fully-bijective operations such as Toffoli type operations. Thus, this more general framework for reversible computing provides a more effective theoretical foundation to use for the design of practical reversible computers than does the more restrictive traditional model of reversible logic. In this paper, we formally develop the theoretical foundations of the generalized model, and briefly survey some of its applications.

Emerging Technologies
Building a Completely Reversible Computer

Martin Lukac,Gerhard W. Dueck,Michitaka Kameyama,Anirban Pathak

DOI: https://doi.org/10.48550/arXiv.1702.08715

2017-02-28

Abstract:A critical analysis of the feasibility of reversible computing is performed. The key question is: Is it possible to build a completely reversible computer? A closer look into the internal aspects of the reversible computing as well as the external constraints such as the second law of thermodynamics has demonstrated that several difficulties would have to be solved before reversible computer is being built. It is shown that a conventional reversible computer would require energy for setting up the reversible inputs from irreversible signals, for the reading out of the reversible outputs, for the transport of the information between logic elements and finally for the control signals that will require more energy dissipating into the environment. A loose bound on the minimum amount of energy required to be dissipated during the physical implementation of a reversible computer is obtained and a generalization of the principles for reversible computing is provided.

Quantum Physics,Emerging Technologies
Quantum Foundations of Classical Reversible Computing

Michael P. Frank,Karpur Shukla

DOI: https://doi.org/10.3390/e23060701

2021-05-28

Abstract:The reversible computation paradigm aims to provide a new foundation for general classical digital computing that is capable of circumventing the thermodynamic limits to the energy efficiency of the conventional, non-reversible digital paradigm. However, to date, the essential rationale for and analysis of classical reversible computing (RC) has not yet been expressed in terms that leverage the modern formal methods of non-equilibrium quantum thermodynamics (NEQT). In this paper, we begin developing an NEQT-based foundation for the physics of reversible computing. We use the framework of Gorini-Kossakowski-Sudarshan-Lindblad dynamics (a.k.a. Lindbladians) with multiple asymptotic states, incorporating recent results from resource theory, full counting statistics, and stochastic thermodynamics. Important conclusions include that, as expected: (1) Landauer's Principle indeed sets a strict lower bound on entropy generation in traditional non-reversible architectures for deterministic computing machines when we account for the loss of correlations; and (2) implementations of the alternative reversible computation paradigm can potentially avoid such losses, and thereby circumvent the Landauer limit, potentially allowing the efficiency of future digital computing technologies to continue improving indefinitely. We also outline a research plan for identifying the fundamental minimum energy dissipation of reversible computing machines as a function of speed.

Quantum Physics,Statistical Mechanics,Emerging Technologies
Compositional Reversible Computation

Jacques Carette,Chris Heunen,Robin Kaarsgaard,Amr Sabry

DOI: https://doi.org/10.1007/978-3-031-62076-8_2

2024-05-31

Abstract:Reversible computing is motivated by both pragmatic and foundational considerations arising from a variety of disciplines. We take a particular path through the development of reversible computation, emphasizing compositional reversible computation. We start from a historical perspective, by reviewing those approaches that developed reversible extensions of lambda-calculi, Turing machines, and communicating process calculi. These approaches share a common challenge: computations made reversible in this way do not naturally compose locally. We then turn our attention to computational models that eschew the detour via existing irreversible models. Building on an original analysis by Landauer, the insights of Bennett, Fredkin, and Toffoli introduced a fresh approach to reversible computing in which reversibility is elevated to the status of the main design principle. These initial models are expressed using low-level bit manipulations, however. Abstracting from the low-level of the Bennett-Fredkin-Toffoli models and pursuing more intrinsic, typed, and algebraic models, naturally leads to rig categories as the canonical model for compositional reversible programming. The categorical model reveals connections to type isomorphisms, symmetries, permutations, groups, and univalent universes. This, in turn, paves the way for extensions to reversible programming based on monads and arrows. These extensions are shown to recover conventional irreversible programming, a variety of reversible computational effects, and more interestingly both pure (measurement-free) and measurement-based quantum programming.

Logic in Computer Science
Reversible Simulation of Irreversible Computation by Pebble Games

Ming Li,John Tromp,Paul Vitanyi

DOI: https://doi.org/10.48550/arXiv.quant-ph/9703009

1997-03-06

Quantum Physics

Abstract:Reversible simulation of irreversible algorithms is analyzed in the stylized form of a `reversible' pebble game. While such simulations incur little overhead in additional computation time, they use a large amount of additional memory space during the computation. The reacheable reversible simulation instantaneous descriptions (pebble configurations) are characterized completely. As a corollary we obtain the reversible simulation by Bennett and that among all simulations that can be modelled by the pebble game, Bennett's simulation is optimal in that it uses the least auxiliary space for the greatest number of simulated steps. One can reduce the auxiliary storage overhead incurred by the reversible simulation at the cost of allowing limited erasing leading to an irreversibility-space tradeoff. We show that in this resource-bounded setting the limited erasing needs to be performed at precise instants during the simulation. We show that the reversible simulation can be modified so that it is applicable also when the simulated computation time is unknown.
Thermodynamics of computations with absolute irreversibility, unidirectional transitions, and stochastic computation times

Gonzalo Manzano,Gülce Kardeş,Édgar Roldán,David Wolpert

DOI: https://doi.org/10.1103/PhysRevX.14.021026

2024-02-17

Abstract:Developing a thermodynamic theory of computation is a challenging task at the interface of non-equilibrium thermodynamics and computer science. In particular, this task requires dealing with difficulties such as stochastic halting times, unidirectional (possibly deterministic) transitions, and restricted initial conditions, features common in real-world computers. Here, we present a framework which tackles all such difficulties by extending the martingale theory of non-equilibrium thermodynamics to generic non-stationary Markovian processes, including those with broken detailed balance and/or absolute irreversibility. We derive several universal fluctuation relations and second-law-like inequalities that provide both lower and upper bounds on the intrinsic dissipation (mismatch cost) associated with any periodic process -- in particular the periodic processes underlying all current digital computation. Crucially, these bounds apply even if the process has stochastic stopping times, as it does in many computational machines. We illustrate our results with exhaustive numerical simulations of deterministic finite automata (DFA) processing bit strings, one of the fundamental models of computation from theoretical computer science. We also provide universal equalities and inequalities for the acceptance probability of words of a given length by a deterministic finite automaton in terms of thermodynamic quantities, and outline connections between computer science and stochastic resetting. Our results, while motivated from the computational context, are applicable far more broadly.

Statistical Mechanics,Computational Physics
Role of Dilations in Reversing Physical Processes: Tabletop Reversibility and Generalized Thermal Operations

Clive Cenxin Aw,Lin Htoo Zaw,Maria Balanzó-Juandó,Valerio Scarani

DOI: https://doi.org/10.1103/PRXQuantum.5.010332

2024-02-27

Abstract:Irreversibility, crucial in both thermodynamics and information theory, is naturally studied by comparing the evolution -- the (forward) channel -- with an associated reverse -- the reverse channel. There are two natural ways to define this reverse channel. Using logical inference, the reverse channel is the Bayesian retrodiction (the Petz recovery map in the quantum formalism) of the original one. Alternatively, we know from physics that every irreversible process can be modeled as an open system: one can then define the corresponding closed system by adding a bath ("dilation"), trivially reverse the global reversible process, and finally remove the bath again. We prove that the two recipes are strictly identical, both in the classical and in the quantum formalism, once one accounts for correlations formed between system and the bath. Having established this, we define and study special classes of maps: product-preserving maps (including generalized thermal maps), for which no such system-bath correlations are formed for some states; and tabletop time-reversible maps, when the reverse channel can be implemented with the same devices as the original one. We establish several general results connecting these classes, and a very detailed characterization when both the system and the bath are one qubit. In particular, we show that when reverse channels are well-defined, product-preservation is a sufficient but not necessary condition for tabletop reversibility; and that the preservation of local energy spectra is a necessary and sufficient condition to generalized thermal operations.

Quantum Physics
Reversibility and Irreversibility within the Quantum Formalism

Tim Jacobs,Christian Maes

DOI: https://doi.org/10.48550/arXiv.quant-ph/0508041

2005-08-04

Abstract:The discussion on time-reversal in quantum mechanics exists at least since Wigner's ``Uber die Operation der Zeitumkehr in der Quantenmechanik'' paper in 1932. If and how the dynamics of the quantum world is time-reversible has been the subject of many controversies. Some have seen quantum mechanics as fundamentally time-irreversible, see for example von Neumann, and some have seen in that the ultimate cause of time's arrow and second law behavior. In his best-selling book ``The Emperor's New Mind'', Roger Penrose argues similarly and concludes that ``our sought-for quantum gravity must be a time-asymmetric theory'' [p.351]. Not so long ago, we read yet about another project in Physicalia 26: to extend quantum mechanics into new fundamentally irreversible equations, thus proposing a new theory giving ``... une description fondamentale irreversible de tout systeme physique''.

Quantum Physics
A Universal Constraint on Computational Rates in Physical Systems

Hannah Earley

DOI: https://doi.org/10.48550/arXiv.2208.11196

2022-10-23

Abstract:Conventional computing has many sources of heat dissipation, but one of these--the Landauer limit--poses a fundamental lower bound of 1 bit of entropy per bit erased. 'Reversible Computing' avoids this source of dissipation, but is dissipationless computation possible? In this paper, a general proof is given for open quantum systems showing that a computer thermally coupled to its environment will necessarily dissipate entropy (and hence heat). Specifically, a lower bound is obtained that corresponds to the adiabatic regime, in which the amount of entropy dissipated per computational operation is proportional to the rate of computation.

Quantum Physics
Time Symmetries of Memory Determine Thermodynamic Efficiency

Alexander B. Boyd,Paul M. Riechers,Gregory W. Wimsatt,James P. Crutchfield,Mile Gu

DOI: https://doi.org/10.48550/arxiv.2104.12072

2021-01-01

Abstract: While Landauer's Principle sets a lower bound for the work required for a computation, that work is recoverable for efficient computations. However, practical physical computers, such as modern digital computers or biochemical systems, are subject to constraints that make them inefficient -- irreversibly dissipating significant energy. Recent results show that the dissipation in such systems is bounded by the nonreciprocity of the embedded computation. We investigate the consequences of this bound for different types of memory, showing that different memory devices are better suited for different computations. This correspondence comes from the time-reversal symmetries of the memory, which depend on whether information is stored positionally or magnetically. This establishes that the time symmetries of the memory device play an essential roll in determining energetics. The energetic consequences of time symmetries are particularly pronounced in nearly deterministic computations, where the cost of computing diverges as minus log of the error rate. We identify the coefficient of that divergence as the dissipation divergence. We find that the dissipation divergence may be zero for a computation when implemented in one type of memory while it's maximal when implemented with another. Given flexibility in the type of memory, the dissipation divergence is bounded below by the average state compression of the computation. Moreover, we show how to explicitly construct the memory to achieve this minimal dissipation. As a result, we find that logically reversible computations are indeed thermodynamically efficient, but logical irreversibility comes at a much higher cost than previously anticipated.
Reversible Computations of One-Way Counter Automata

Martin Kutrib,Andreas Malcher,H. Bordihn,G. Vaszil,G. Horváth

DOI: https://doi.org/10.1051/ita/2023011

2024-03-15

RAIRO - Theoretical Informatics and Applications

Abstract:Deterministic one-way time-bounded multi-counter automata are studied with respect to their ability to perform reversible computations, which means that the automata are also backward deterministic and, thus, are able to uniquely step the computation back and forth. We study the computational capacity of such devices and obtain separation results between irreversible and reversible k-counter automata for polynomial and superpolynomial time. For polynomial time and exponential time we obtain moreover infinite and tight hierarchies with respect to the number of counters. These hierarchies are shown with Kolmogorov complexity and incompressibility arguments. In this way, on passing we can prove these hierarchies also for ordinary counter automata. This improves the known hierarchies for ordinary counter automata in the sense that we consider here a weaker acceptance condition. Then, it turns out that k +1 reversible counters are not better than k ordinary counters and vice versa. Finally, almost all usually studied decidability questions turn out to be undecidable and not even semidecidable for reversible multi-counter automata, if at least two counters are provided. In case of reversible one-counter automata, it is possible to show that the inclusion problem is also not even semidecidable.

computer science, theory & methods,mathematics, applied
Finite-Time Processes In Quantum Thermodynamics: The Limits Of Irreversibility

Alberto Rolandi

DOI: https://doi.org/10.13097/archive-ouverte/unige%3A180515

2024-10-25

Abstract:The emergence of irreversibility in physical processes, despite the fundamentally reversible nature of quantum mechanics, remains an open question in physics. This thesis explores the intricate relationship between quantum mechanics and thermodynamics, with a particular focus on minimizing entropy production in finite-time processes. By employing tools from quantum information theory and geometric thermodynamics, we tackle the challenge of deriving irreversible thermodynamic behavior from the reversible microscopic framework of quantum mechanics. We begin with a comprehensive review of the laws of thermodynamics, setting the stage for the subsequent analyses. We introduce novel developments in quantum thermodynamics through a generalized framework for geometric thermodynamics, which enables the derivation of finite-time corrections beyond the Markovian regime. Building on this foundation, we extend Landauer's principle by incorporating a finite-time correction that highlights the necessity of strong coupling for optimal information erasure processes. This result underscores the emergence of Planckian time as a fundamental speed limit to thermalization. Additionally, we explore how collective effects can be harnessed to reduce energy dissipation in thermodynamic operations, revealing that classical correlations between systems can significantly mitigate dissipation, though this may pose new questions regarding the third law of thermodynamics. Finally, we optimize thermodynamic processes in mesoscopic systems, including quantum dot engines and information engines. These findings not only enhance our understanding of the fundamental limits of irreversibility but also open new avenues for research. Future works will focus on fully exploiting collective effects, aligning these with the third law of thermodynamics, and understanding the thermodynamic consistency of master equations.

Quantum Physics,Statistical Mechanics
Stochastic thermodynamics of computation

David H. Wolpert

DOI: https://doi.org/10.1088/1751-8121/ab0850

2023-02-17

Abstract:One of the major resource requirements of computers - ranging from biological cells to human brains to high-performance (engineered) computers - is the energy used to run them. Those costs of performing a computation have long been a focus of research in physics, going back to the early work of Landauer. One of the most prominent aspects of computers is that they are inherently nonequilibrium systems. However, the early research was done when nonequilibrium statistical physics was in its infancy, which meant the work was formulated in terms of equilibrium statistical physics. Since then there have been major breakthroughs in nonequilibrium statistical physics, which are allowing us to investigate the myriad aspects of the relationship between statistical physics and computation, extending well beyond the issue of how much work is required to erase a bit. In this paper I review some of this recent work on the `stochastic thermodynamics of computation'. After reviewing the salient parts of information theory, computer science theory, and stochastic thermodynamics, I summarize what has been learned about the entropic costs of performing a broad range of computations, extending from bit erasure to loop-free circuits to logically reversible circuits to information ratchets to Turing machines. These results reveal new, challenging engineering problems for how to design computers to have minimal thermodynamic costs. They also allow us to start to combine computer science theory and stochastic thermodynamics at a foundational level, thereby expanding both.

Statistical Mechanics,Computational Complexity
Design of Reversible Computing Systems; Large Logic, Languages, and Circuits

Michael Kirkedal Thomsen

2023-09-21

Abstract:This PhD dissertation investigates garbage-free reversible computing systems from abstract design to physical gate-level implementation. Designed in reversible logic, we propose a ripple-block carry adder and work towards a reversible circuit for general multiplication. At a higher-level, abstract designs are proposed for reversible systems, such as a small von Neumann architecture that can execute programs written in a simple reversible two-address instruction set, a novel reversible arithmetic logic unit, and a linear cosine transform. To aid the design of reversible logic circuits we have designed two reversible functional hardware description languages: a linear-typed higher-level language and a gate-level point-free combinator language. We suggest a garbage-free design flow, where circuits are described in the higher-level language and then translated to the combinator language, from which methods to place-and-route of CMOS gates can be applied. We have also made standard cell layouts of the reversible gates in complementary pass-gate CMOS logic and used these to fabricate the ALU design. In total, this dissertation has shown that it is possible to design non-trivial reversible computing systems without garbage and that support from languages (computer aided design) can make this process easier.

Programming Languages
Reversible computation as a model for the quantum measurement process

Karl Svozil

DOI: https://doi.org/10.48550/arXiv.0904.2286

2009-04-15

Quantum Physics

Abstract:One-to-one reversible automata are introduced. Their applicability to a modelling of the quantum mechanical measurement process is discussed.
Synthesis and Optimization of Reversible Circuits - A Survey

Mehdi Saeedi,Igor L. Markov

DOI: https://doi.org/10.1145/2431211.2431220

2013-03-21

Abstract:Reversible logic circuits have been historically motivated by theoretical research in low-power electronics as well as practical improvement of bit-manipulation transforms in cryptography and computer graphics. Recently, reversible circuits have attracted interest as components of quantum algorithms, as well as in photonic and nano-computing technologies where some switching devices offer no signal gain. Research in generating reversible logic distinguishes between circuit synthesis, post-synthesis optimization, and technology mapping. In this survey, we review algorithmic paradigms --- search-based, cycle-based, transformation-based, and BDD-based --- as well as specific algorithms for reversible synthesis, both exact and heuristic. We conclude the survey by outlining key open challenges in synthesis of reversible and quantum logic, as well as most common misconceptions.

Emerging Technologies,Quantum Physics
The phase/state duality in reversible circuit design

Matthew Amy,Neil J. Ross

DOI: https://doi.org/10.1103/PhysRevA.104.052602

2021-11-05

Abstract:The reversible implementation of classical functions accounts for the bulk of most known quantum algorithms. As a result, a number of reversible circuit constructions over the Clifford+$T$ gate set have been developed in recent years which use both the state and phase spaces, or $X$ and $Z$ bases, to reduce circuit costs beyond what is possible at the strictly classical level. We study and generalize two particular classes of these constructions: relative phase circuits, including Giles and Selinger's multiply-controlled $iX$ gates and Maslov's $4$ qubit Toffoli gate, and measurement-assisted circuits, including Jones' Toffoli gate and Gidney's temporary logical-AND. In doing so, we introduce general methods for implementing classical functions up to phase and for measurement-assisted termination of temporary values. We then apply these techniques to find novel $T$-count efficient constructions of some classical functions in space-constrained regimes, notably multiply-controlled Toffoli gates and temporary products.

Quantum Physics
The Complexity of Iterated Reversible Computation

David Eppstein

DOI: https://doi.org/10.46298/theoretics.23.10

2023-12-19

Abstract:We study a class of functional problems reducible to computing $f^{(n)}(x)$ for inputs $n$ and $x$, where $f$ is a polynomial-time bijection. As we prove, the definition is robust against variations in the type of reduction used in its definition, and in whether we require $f$ to have a polynomial-time inverse or to be computible by a reversible logic circuit. These problems are characterized by the complexity class $\mathsf{FP}^{\mathsf{PSPACE}}$, and include natural $\mathsf{FP}^{\mathsf{PSPACE}}$-complete problems in circuit complexity, cellular automata, graph algorithms, and the dynamical systems described by piecewise-linear transformations.

Computational Complexity,Cellular Automata and Lattice Gases
Controlled Erasure as a Building Block for Universal Thermodynamically-Robust Superconducting Computing

Christian Z. Pratt,Kyle J. Ray,James P. Crutchfield

2024-07-01

Abstract:Reducing the energy inefficiency of conventional CMOS-based computing devices -- which rely on logically irreversible gates to process information -- remains both a fundamental engineering challenge and a practical social challenge of increasing importance. We extend an alternative computing paradigm that manipulates microstate distributions to store information in the metastable minima determined by an effective potential energy landscape. These minima serve as mesoscopic memories that are manipulated by a dynamic landscape to perform information processing. Central to our results is the control erase (CE) protocol that controls the landscape's metastable minima to determine whether information is preserved or erased. Importantly, successive protocol executions can implement a NAND gate -- a logically-irreversible universal logic gate. We show how to practically implement this in a device created by two inductively-coupled superconducting quantum interference devices (SQUIDs). We identify circuit parameter ranges that give rise to effective CEs and establish the device's robustness against logical errors. These SQUID-based logical devices are capable of operating above GHz frequencies and at the $k_\text{B} T$ energy scale. Due to this, optimized devices and associated protocols provide a universal-computation substrate that is both computationally fast and energy efficient.

Superconductivity,Mesoscale and Nanoscale Physics,Statistical Mechanics
Occam's Vorpal Quantum Razor: Memory Reduction when Simulating Continuous-Time Stochastic Processes with Quantum Devices

Thomas J. Elliott,Mile Gu

2017-01-01

Abstract:Continuous-time stochastic processes pervade everyday experience, and the simulation of models of these processes is of great utility. Classical models of systems operating in continuous-time must typically track an unbounded amount of information about past behaviour, even for relatively simple models, enforcing limits on precision due to the finite memory of the machine. However, quantum machines can require less information about the past than even their optimal classical counterparts to simulate the future of discrete-time processes, and we demonstrate that this advantage extends to the continuous-time regime. Moreover, we show that this reduction in the memory requirement can be unboundedly large, allowing for arbitrary precision even with a finite quantum memory. We provide a systematic method for finding superior quantum constructions, and a protocol for analogue simulation of continuous-time renewal processes with a quantum machine.

Time, Space, and Energy in Reversible Computing

Generalized Reversible Computing

Building a Completely Reversible Computer

Quantum Foundations of Classical Reversible Computing

Compositional Reversible Computation

Reversible Simulation of Irreversible Computation by Pebble Games

Thermodynamics of computations with absolute irreversibility, unidirectional transitions, and stochastic computation times

Role of Dilations in Reversing Physical Processes: Tabletop Reversibility and Generalized Thermal Operations

Reversibility and Irreversibility within the Quantum Formalism

A Universal Constraint on Computational Rates in Physical Systems

Time Symmetries of Memory Determine Thermodynamic Efficiency

Reversible Computations of One-Way Counter Automata

Finite-Time Processes In Quantum Thermodynamics: The Limits Of Irreversibility

Stochastic thermodynamics of computation

Design of Reversible Computing Systems; Large Logic, Languages, and Circuits

Reversible computation as a model for the quantum measurement process

Synthesis and Optimization of Reversible Circuits - A Survey

The phase/state duality in reversible circuit design

The Complexity of Iterated Reversible Computation

Controlled Erasure as a Building Block for Universal Thermodynamically-Robust Superconducting Computing

Occam's Vorpal Quantum Razor: Memory Reduction when Simulating Continuous-Time Stochastic Processes with Quantum Devices