The complexity of computing in continuous time: space complexity is precision

Manon Blanc,Olivier Bournez

2024-03-05

Abstract:Models of computations over the integers are equivalent from a computability and complexity theory point of view by the Church-Turing thesis. It is not possible to unify discrete-time models over the reals. The situation is unclear but simpler for continuous-time models, as there is a unifying mathematical model provided by ordinary differential equations (ODEs). For example, the GPAC model of Shannon is known to correspond to polynomial ODEs. However, the question of a robust complexity theory for such models and its relations to classical (discrete) computation theory is an old problem. There was some recent significant progress: it has been proved that (classical) time complexity corresponds to the length of the involved curves. The question of whether there is a simple and robust way to measure space complexity remains. We argue that space complexity corresponds to precision and conversely. We propose and prove an algebraic characterisation of FPSPACE, using continuous ODEs. Recent papers proposed algebraic characterisations of polynomial-time and -space complexity classes over the reals, but with a discrete-time: those algebras rely on discrete ODE schemes. Here, we use classical (continuous) ODEs, with the classic definition of derivation and hence with the more natural context of continuous-time associated with ODEs. We characterise both the case of polynomial space functions over the integers and the reals. We prove that Turing machines, with a proper representation of real numbers, can be simulated by continuous ODEs and not just discrete ODEs. A major consequence is that the associated space complexity is provably related to the numerical stability of involved schemas and the associated required precision. We obtain that a problem can be solved in polynomial space if and only if it can be simulated by some numerically stable ODE, using a polynomial precision.

Computational Complexity

What problem does this paper attempt to address?

The paper discusses the complexity theory issues in continuous time computation, particularly focusing on how to define and measure space complexity. The author points out that there are different computational theories in discrete time models such as Turing machines and the Blum-Shub-Smale model, which cannot be unified. However, in continuous time models, a unified mathematical description can be provided through ordinary differential equations (ODEs). Nevertheless, establishing robust complexity theory for these models remains challenging.

The paper addresses time complexity associated with the length of ODE solution curves, but the measurement of space complexity remains unclear. The author proposes that space complexity is directly related to accuracy, i.e., a problem can be solved within polynomial space if it can be simulated as a numerically stable ODE using polynomial precision. They use continuous ODEs to provide an algebraic characterization of FPSPACE (polynomial space complexity class) and demonstrate the polynomial space complexity for integer and real-valued functions.

The paper also mentions previous breakthroughs such as linking time complexity with curve length and demonstrating that Turing machines can be simulated by continuous ODEs instead of discrete ODEs, indicating the relevance of space complexity to numerical stability and required precision.

In summary, the main contribution of the paper is proposing an equivalence relationship between space complexity and numerical stability and precision of ODEs, along with corresponding theorem proofs. This provides a new perspective for understanding and simulating computational complexity in continuous time.