Nondeterminism and Guarded Commands

Krzysztof R. Apt,Ernst-Rüdiger Olderog

2023-10-13

Abstract:The purpose of this paper is to discuss the relevance of nondeterminism in computer science, with a special emphasis on Dijkstra's guarded commands language.

Programming Languages

What problem does this paper attempt to address?

Unifying Probability with Nondeterminism

Yifeng Chen,J. W. Sanders

DOI: https://doi.org/10.1007/978-3-642-05089-3_30

2009-01-01

Abstract:Early support for reasoning about probabilistic system behaviour replaced nondeterminism with probabilism. Only relatively recently have formalisms been studied that combine the two, and hence facilitate reasoning about probabilistic systems at levels of abstraction more general than code. Such studies have revealed an unsuspected subtlety in the interaction between nondeterministic and probabilistic choices that can be summarised: the demon resolving the nondeterministic choice has memory of previous state changes, whilst the probabilistic choice is made spontaneously. As a result, assignments to distinct variables need no longer commute. This paper introduces a model with explicit control of the length of the demon's memory. It does so by expanding the standard (initial-final) state view of computation to incorporate a third state, the `original' state which checkpoints the most recent nondeterministic choice. That enables a nondeterministic choice to be made on the basis of only certain past probabilistic choices and so facilitates independent nondeterministic combinations to be chosen against just those. Sound laws are presented and used to analyse first an example in which no new behaviour should result, and second one that lies beyond the scope of traditional models.
Abstraction of Nondeterministic Situation Calculus Action Theories -- Extended Version

Bita Banihashemi,Giuseppe De Giacomo,Yves Lespérance

DOI: https://doi.org/10.48550/arXiv.2305.14222

2023-05-20

Abstract:We develop a general framework for abstracting the behavior of an agent that operates in a nondeterministic domain, i.e., where the agent does not control the outcome of the nondeterministic actions, based on the nondeterministic situation calculus and the ConGolog programming language. We assume that we have both an abstract and a concrete nondeterministic basic action theory, and a refinement mapping which specifies how abstract actions, decomposed into agent actions and environment reactions, are implemented by concrete ConGolog programs. This new setting supports strategic reasoning and strategy synthesis, by allowing us to quantify separately on agent actions and environment reactions. We show that if the agent has a (strong FOND) plan/strategy to achieve a goal/complete a task at the abstract level, and it can always execute the nondeterministic abstract actions to completion at the concrete level, then there exists a refinement of it that is a (strong FOND) plan/strategy to achieve the refinement of the goal/task at the concrete level.

Logic in Computer Science,Artificial Intelligence
Non-Cartesian Guarded Recursion with Daggers

Louis Lemonnier

2024-09-23

Abstract:Guarded recursion is a framework allowing for a formalisation of streams in classical programming languages. The latter take their semantics in cartesian closed categories. However, some programming paradigms do not take their semantics in a cartesian setting; this is the case for concurrency, reversible and quantum programming for example. In this paper, we focus on reversible programming through the prism of dagger categories, which are categories that contain an involutive operator on morphisms. After presenting classical guarded recursion, we show how to introduce this framework into dagger categories. Given a dagger category, we build categories shown to be suitable for guarded recursion in multiple ways, via enrichment and fixed point theorems. Finally, we show that our construction is suitable as a model of reversible programming languages, such as symmetric pattern-matching.

Logic in Computer Science,Programming Languages,Category Theory
Modelling Recursion and Probabilistic Choice in Guarded Type Theory

Philipp Jan Andries Stassen,Rasmus Ejlers Møgelberg,Maaike Zwart,Alejandro Aguirre,Lars Birkedal

2024-10-24

Abstract:Constructive type theory combines logic and programming in one language. This is useful both for reasoning about programs written in type theory, as well as for reasoning about other programming languages inside type theory. It is well-known that it is challenging to extend these applications to languages with recursion and computational effects such as probabilistic choice, because these features are not easily represented in constructive type theory. We show how to define and reason about a programming language with probabilistic choice and recursive types, in guarded type theory. We use higher inductive types to represent finite distributions and guarded recursion to model recursion. We define both operational and denotational semantics, as well as a relation between the two. The relation can be used to prove adequacy, but we also show how to use it to reason about programs up to contextual equivalence.

Programming Languages,Logic in Computer Science
Dynamic enforcement of determinism in a parallel scripting language

Li Lu,Weixing Ji,Michael L. Scott

DOI: https://doi.org/10.1145/2594291.2594300

2014-06-09

Abstract:Determinism is an appealing property for parallel programs, as it simplifies understanding, reasoning and debugging. It is particularly appealing in dynamic (scripting) languages, where ease of programming is a dominant design goal. Some existing parallel languages use the type system to enforce determinism statically, but this is not generally practical for dynamic languages. In this paper, we describe how determinism can be obtained---and dynamically enforced/verified---for appropriate extensions to a parallel scripting language. Specifically, we introduce the constructs of Deterministic Parallel Ruby (DPR), together with a run-time system (Tardis) that verifies properties required for determinism, including correct usage of reductions and commutative operators, and the mutual independence (data-race freedom) of concurrent tasks. Experimental results confirm that DPR can provide scalable performance on multicore machines and that the overhead of Tardis is low enough for practical testing. In particular, Tardis significantly outperforms alternative data-race detectors with comparable functionality. We conclude with a discussion of future directions in the dynamic enforcement of determinism.
Non Deterministic Logic Programs

Emad Saad

DOI: https://doi.org/10.48550/arXiv.1304.7168

IF: 14.4

2013-04-26

Artificial Intelligence

Abstract:Non deterministic applications arise in many domains, including, stochastic optimization, multi-objectives optimization, stochastic planning, contingent stochastic planning, reinforcement learning, reinforcement learning in partially observable Markov decision processes, and conditional planning. We present a logic programming framework called non deterministic logic programs, along with a declarative semantics and fixpoint semantics, to allow representing and reasoning about inherently non deterministic real-world applications. The language of non deterministic logic programs framework is extended with non-monotonic negation, and two alternative semantics are defined: the stable non deterministic model semantics and the well-founded non deterministic model semantics as well as their relationship is studied. These semantics subsume the deterministic stable model semantics and the deterministic well-founded semantics of deterministic normal logic programs, and they reduce to the semantics of deterministic definite logic programs without negation. We show the application of the non deterministic logic programs framework to a conditional planning problem.
Typed Non-determinism in Functional and Concurrent Calculi

Bas van den Heuvel,Joseph W. N. Paulus,Daniele Nantes-Sobrinho,Jorge A. Pérez

2023-09-29

Abstract:We study functional and concurrent calculi with non-determinism, along with type systems to control resources based on linearity. The interplay between non-determinism and linearity is delicate: careless handling of branches can discard resources meant to be used exactly once. Here we go beyond prior work by considering non-determinism in its standard sense: once a branch is selected, the rest are discarded. Our technical contributions are three-fold. First, we introduce a $\pi$-calculus with non-deterministic choice, governed by session types. Second, we introduce a resource $\lambda$-calculus, governed by intersection types, in which non-determinism concerns fetching of resources from bags. Finally, we connect our two typed non-deterministic calculi via a correct translation.

Logic in Computer Science
History Determinism vs. Good for Gameness in Quantitative Automata

Udi Boker,Karoliina Lehtinen

DOI: https://doi.org/10.48550/arXiv.2110.14238

2021-10-27

Abstract:Automata models between determinism and nondeterminism/alternations can retain some of the algorithmic properties of deterministic automata while enjoying some of the expressiveness and succinctness of nondeterminism. We study three closely related such models -- history determinism, good for gameness and determinisability by pruning -- on quantitative automata. While in the Boolean setting, history determinism and good for gameness coincide, we show that this is no longer the case in the quantitative setting: good for gameness is broader than history determinism, and coincides with a relaxed version of it, defined with respect to thresholds. We further identify criteria in which history determinism, which is generally broader than determinisability by pruning, coincides with it, which we then apply to typical quantitative automata types. As a key application of good for games and history deterministic automata is synthesis, we clarify the relationship between the two notions and various quantitative synthesis problems. We show that good-for-games automata are central for "global" (classical) synthesis, while "local" (good-enough) synthesis reduces to deciding whether a nondeterministic automaton is history deterministic.

Formal Languages and Automata Theory
A Demonic Outcome Logic for Randomized Nondeterminism

Noam Zilberstein,Dexter Kozen,Alexandra Silva,Joseph Tassarotti

2024-10-30

Abstract:Programs increasingly rely on randomization in applications such as cryptography and machine learning. Analyzing randomized programs has been a fruitful research direction, but there is a gap when programs also exploit nondeterminism (for concurrency, efficiency, or algorithmic design). In this paper, we introduce Demonic Outcome Logic for reasoning about programs that exploit both randomization and nondeterminism. The logic includes several novel features, such as reasoning about multiple executions in tandem and manipulating pre- and postconditions using familiar equational laws -- including the distributive law of probabilistic choices over nondeterministic ones. We also give rules for loops that both establish termination and quantify the distribution of final outcomes from a single premise. We illustrate the reasoning capabilities of Demonic Outcome Logic through several case studies, including the Monty Hall problem, an adversarial protocol for simulating fair coins, and a heuristic based probabilistic SAT solver.

Logic in Computer Science,Programming Languages
An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Shuyin Ouyang,Jie M. Zhang,Mark Harman,Meng Wang

DOI: https://doi.org/10.1145/3697010

2024-10-18

Abstract:There has been a recent explosion of research on Large Language Models (LLMs) for software engineering tasks, in particular code generation. However, results from LLMs can be highly unstable; nondeterministically returning very different codes for the same prompt. Non-determinism is a potential menace to scientific conclusion validity. When non-determinism is high, scientific conclusions simply cannot be relied upon unless researchers change their behaviour to control for it in their empirical analyses. This paper conducts an empirical study to demonstrate that non-determinism is, indeed, high, thereby underlining the need for this behavioural change. We choose to study ChatGPT because it is already highly prevalent in the code generation research literature. We report results from a study of 829 code generation problems from three code generation benchmarks (i.e., CodeContests, APPS, and HumanEval). Our results reveal high degrees of non-determinism: the ratio of coding tasks with zero equal test output across different requests is 75.76%, 51.00%, and 47.56% for CodeContests, APPS, and HumanEval, respectively. In addition, we find that setting the temperature to 0 does not guarantee determinism in code generation, although it indeed brings less non-determinism than the default configuration (temperature=1). These results confirm that there is, currently, a significant threat to scientific conclusion validity. In order to put LLM-based research on firmer scientific foundations, researchers need to take into account non-determinism in drawing their conclusions.

Software Engineering
Space-time deterministic graph rewriting

Pablo Arrighi,Marin Costes,Gilles Dowek,Luidnel Maignan

2024-10-07

Abstract:We study non-terminating graph rewriting models, whose local rules are applied non-deterministically -- and yet enjoy a strong form of determinism, namely space-time determinism. Of course in the case of terminating computation it is well-known that the mess introduced by asynchronous rule applications may not matter to the end result, as confluence conspires to produce a unique normal form. In the context of non-terminating computation however, confluence is a very weak property, and (almost) synchronous rule applications is always preferred e.g. when it comes to simulating dynamical systems. Here we provide sufficient conditions so that asynchronous local rule applications conspire to produce well-determined events in the space-time unfolding of the graph, regardless of their application orders. Our first example is an asynchronous simulation of a dynamical system. Our second example features time dilation, in the spirit of general relativity.

Discrete Mathematics,Distributed, Parallel, and Cluster Computing,General Relativity and Quantum Cosmology,Dynamical Systems,Cellular Automata and Lattice Gases
Verification of Nondeterministic Quantum Programs

Yuan Feng,Yingte Xu

DOI: https://doi.org/10.1145/3582016.3582039

2023-01-01

Abstract: Nondeterministic choice is a useful program construct that provides a way to describe the behaviour of a program without specifying the details of possible implementations. It supports the stepwise refinement of programs, a method that has proven useful in software development. Nondeterminism has also been introduced in quantum programming, and the termination of nondeterministic quantum programs has been extensively analysed. In this paper, we go beyond termination analysis to investigate the verification of nondeterministic quantum programs where properties are given by sets of hermitian operators on the associated Hilbert space. Hoare-type logic systems for partial and total correctness are proposed, which turn out to be both sound and relatively complete with respect to their corresponding semantic correctness. To show the utility of these proof systems, we analyse some quantum algorithms, such as quantum error correction scheme, the Deutsch algorithm, and a nondeterministic quantum walk. Finally, a proof assistant prototype is implemented to aid in the automated reasoning of nondeterministic quantum programs.
Concrete Semantics of Programs with Non-Deterministic and Random Inputs

Assalé Adjé,Jean Goubault-Larrecq

DOI: https://doi.org/10.48550/arXiv.1210.2605

2012-10-08

Abstract:This document gives semantics to programs written in a C-like programming language, featuring interactions with an external environment with noisy and imprecise data.

Logic in Computer Science,Formal Languages and Automata Theory
Non-deterministic computation and the Jayne-Rogers Theorem

Arno Pauly,Matthew de Brecht

DOI: https://doi.org/10.48550/arXiv.1404.0079

2014-04-01

Logic in Computer Science

Abstract:We provide a simple proof of a computable analogue to the Jayne Rogers Theorem from descriptive set theory. The difficulty of the proof is delegated to a simulation result pertaining to non-deterministic type-2 machines. Thus, we demonstrate that developments in computational models can have applications in fields thought to be far removed from it.
Queries with Guarded Negation (full version)

Vince Barany,Balder ten Cate,Martin Otto

DOI: https://doi.org/10.48550/arXiv.1203.0077

2012-03-01

Abstract:A well-established and fundamental insight in database theory is that negation (also known as complementation) tends to make queries difficult to process and difficult to reason about. Many basic problems are decidable and admit practical algorithms in the case of unions of conjunctive queries, but become difficult or even undecidable when queries are allowed to contain negation. Inspired by recent results in finite model theory, we consider a restricted form of negation, guarded negation. We introduce a fragment of SQL, called GN-SQL, as well as a fragment of Datalog with stratified negation, called GN-Datalog, that allow only guarded negation, and we show that these query languages are computationally well behaved, in terms of testing query containment, query evaluation, open-world query answering, and boundedness. GN-SQL and GN-Datalog subsume a number of well known query languages and constraint languages, such as unions of conjunctive queries, monadic Datalog, and frontier-guarded tgds. In addition, an analysis of standard benchmark workloads shows that most usage of negation in SQL in practice is guarded negation.

Databases
History-Determinism vs Fair Simulation

Udi Boker,Thomas A. Henzinger,Karoliina Lehtinen,Aditya Prakash

2024-07-11

Abstract:An automaton is history-deterministic if its nondeterminism can be resolved on the fly, only using the prefix of the word read so far. This mild form of nondeterminism has attracted particular attention for its applications in synthesis problems. An automaton $A$ is guidable with respect to a class $C$ of automata if it can fairly simulate every automaton in $C$ whose language is contained in that of $A$. In other words, guidable automata are those for which inclusion and simulation coincide, making them particularly interesting for model-checking. We study the connection between these two notions, and specifically the question of when they coincide. For classes of automata on which they do, deciding guidability, an otherwise challenging decision problem, reduces to deciding history-determinism, a problem that is starting to be well-understood for many classes. We provide a selection of sufficient criteria for a class of automata to guarantee the coincidence of the notions, and use them to show that the notions coincide for the most common automata classes, among which are $\omega$-regular automata and many infinite-state automata with safety and reachability acceptance conditions, including vector addition systems with states, one-counter nets, pushdown-, Parikh-, and timed-automata. We also demonstrate that history-determinism and guidability do not always coincide, for example, for the classes of timed automata with a fixed number of clocks.

Formal Languages and Automata Theory
Non-determinism in Byzantine Fault-Tolerant Replication

Christian Cachin,Simon Schubert,Marko Vukolić

DOI: https://doi.org/10.48550/arXiv.1603.07351

2016-12-20

Abstract:Service replication distributes an application over many processes for tolerating faults, attacks, and misbehavior among a subset of the processes. The established state-machine replication paradigm inherently requires the application to be deterministic. This paper distinguishes three models for dealing with non-determinism in replicated services, where some processes are subject to faults and arbitrary behavior (so-called Byzantine faults): first, a modular approach that does not require any changes to the potentially non-deterministic application (and neither access to its internal data); second, a master-slave approach, in which ties are broken by a leader and the other processes validate the choices of the leader; and finally, a treatment of applications that use cryptography and secret keys. Cryptographic operations and secrets must be treated specially because they require strong randomness to satisfy their goals. The paper also introduces two new protocols. The first uses the modular approach for filtering out non-de\-ter\-min\-istic operations in an application. It ensures that all correct processes produce the same outputs and that their internal states do not diverge. The second protocol implements cryptographically secure randomness generation with a verifiable random function and is appropriate for certain security models. All protocols are described in a generic way and do not assume a particular implementation of the underlying consensus primitive.

Distributed, Parallel, and Cluster Computing,Cryptography and Security
Indeterminacy after AI: Introduction to Special Section

DOI: https://doi.org/10.1162/leon_e_02299

2023-01-01

Leonardo

Abstract:Abstract There is a close connection between the avant-garde—Dadaist, Surrealist, and Constructivist—use of indeterminate procedures and the early-twentieth-century scientific theories of indeterminacy, such as those of Niels Bohr, Kurt Gödel, and Alan Turing. The Dadaist disruption of ingrained logics, through collage, chance operations, and the simultaneous poem, transcended causality to liberate “an infinite set of processes and possibilities” [1]. Surrealist psycho-archaeological techniques—automatic drawing, writing, and frottage—redefined automaticity as a source of a deeper, nonconscious surreality. Constructivism, similarly, made use of incongruous micro and macro fragments, collapsing orders of magnitude to “reassemble” the world along different axes. In quantum physics, Bohr demonstrated the entanglement of the observer, phenomenon, conceptual framework, and measuring apparatus. Given that all quantum experiments presuppose a question about either position (the particle aspect of a phenomenon) or movement (its wave aspect), but not about both at the same time, they could not deterministically predict an(y) individual atomic process, only statistical regularities. Gödel similarly demonstrated the incompleteness of formal axiomatic systems by showing that there are propositions that can neither be proven nor disproven. Elaborating mathematician David Hilbert’s Entscheidungsproblem—the question about the final decidability or predictability of universal logics—Turing likewise demonstrated that some functions cannot be computed.
Promise Algebra: An Algebraic Model of Non-Deterministic Computations

Eugenia Ternovska

2023-11-21

Abstract:Our goal is to define an algebraic language for reasoning about non-deterministic computations. Towards this goal, we introduce an algebra of string-to-string transductions. Specifically, it is an algebra of partial functions on words over the alphabet of relational $\tau$-structures over the same domain. The algebra has a two-level syntax, and thus, two parameters to control its expressive power. The top level defines algebraic expressions, and the bottom level specifies atomic transitions. History-dependent Choice functions resolve atomic non-determinism, and make general relations functional. Equivalence classes of such functions serve as certificates for computational problems specified by algebraic terms. The algebra has an equivalent syntax in the form of a Dynamic Logic, where terms describing computational processes or programs appear inside the modalities. We define a simple secondary logic for representing atomic transitions, which is a modification of conjunctive queries. With this logic, the algebra can represent both reachability and counting examples, which is not possible in Datalog. We analyze the data complexity of this logic, measured in the size of the input structure, and show that a restricted fragment of the logic captures the complexity class NP. The logic can be viewed as a database query language, where atomic propagations are separated from control.

Logic in Computer Science,Databases
A Survey of Graph Comparison Methods with Applications to Nondeterminism in High-Performance Computing

Sanjukta Bhowmick,Patrick Bell,Michela Taufer

DOI: https://doi.org/10.1177/10943420231166610

2023-04-07

Abstract:The International Journal of High Performance Computing Applications, Ahead of Print. The convergence of extremely high levels of hardware concurrency and the effective overlap of computation and communication in asynchronous executions has resulted in increasing nondeterminism in High-Performance Computing (HPC) applications. Nondeterminism can manifest at multiple levels: from low-level communication primitives to libraries to application-level functions. No matter its source, nondeterminism can drastically increase the cost of result reproducibility, debugging workflows, testing parallel programs, or ensuring fault-tolerance. Nondeterministic executions of HPC applications can be modeled as event graphs, and the applications' nondeterministic behavior can be understood and, in some cases, mitigated using graph comparison algorithms. However, a connection between graph comparison algorithms and approaches to understanding nondeterminism in HPC still needs to be established. This survey article moves the first steps toward establishing a connection between graph comparison algorithms and nondeterminism in HPC with its three contributions: it provides a survey of different graph comparison algorithms and a timeline for each category's significant works; it discusses how existing graph comparison methods do not fully support properties needed to understand nondeterministic patterns in HPC applications; and it presents the open challenges that should be addressed to leverage the power of graph comparisons for the study of nondeterminism in HPC applications.

computer science, theory & methods, interdisciplinary applications, hardware & architecture

Nondeterminism and Guarded Commands

Unifying Probability with Nondeterminism

Abstraction of Nondeterministic Situation Calculus Action Theories -- Extended Version

Non-Cartesian Guarded Recursion with Daggers

Modelling Recursion and Probabilistic Choice in Guarded Type Theory

Dynamic enforcement of determinism in a parallel scripting language

Non Deterministic Logic Programs

Typed Non-determinism in Functional and Concurrent Calculi

History Determinism vs. Good for Gameness in Quantitative Automata

A Demonic Outcome Logic for Randomized Nondeterminism

An Empirical Study of the Non-determinism of ChatGPT in Code Generation

Space-time deterministic graph rewriting

Verification of Nondeterministic Quantum Programs

Concrete Semantics of Programs with Non-Deterministic and Random Inputs

Non-deterministic computation and the Jayne-Rogers Theorem

Queries with Guarded Negation (full version)

History-Determinism vs Fair Simulation

Non-determinism in Byzantine Fault-Tolerant Replication

Indeterminacy after AI: Introduction to Special Section

Promise Algebra: An Algebraic Model of Non-Deterministic Computations

A Survey of Graph Comparison Methods with Applications to Nondeterminism in High-Performance Computing