Execution Semantics of Behavior Trees in Robotic Applications

Enrico Ghiorzi,Armando Tacchella

2024-08-01

Abstract:This document aims at describing, in a suitably precise and unambiguous though informal way, the execution semantics of Behavior Trees as used in Robotics applications, with particular attention to the Halt semantics.

Robotics,Artificial Intelligence

What problem does this paper attempt to address?

A Resourceful Reframing of Behavior Trees

Chris Martens,Eric Butler,Joseph C. Osborn

DOI: https://doi.org/10.48550/arXiv.1803.09099

2018-03-24

Programming Languages

Abstract:Designers of autonomous agents, whether in physical or virtual environments, need to express nondeterminisim, failure, and parallelism in behaviors, as well as accounting for synchronous coordination between agents. Behavior Trees are a semi-formalism deployed widely for this purpose in the games industry, but with challenges to scalability, reasoning, and reuse of common sub-behaviors. We present an alternative formulation of behavior trees through a language design perspective, giving a formal operational semantics, type system, and corresponding implementation. We express specifications for atomic behaviors as linear logic formulas describing how they transform the environment, and our type system uses linear sequent calculus to derive a compositional type assignment to behavior tree expressions. These types expose the conditions required for behaviors to succeed and allow abstraction over parameters to behaviors, enabling the development of behavior "building blocks" amenable to compositional reasoning and reuse.
Behavior Trees in Action: A Study of Robotics Applications

Razan Ghzouli,Thorsten Berger,Einar Broch Johnsen,Swaib Dragule,Andrzej Wąsowski

DOI: https://doi.org/10.1145/3426425.3426942

2020-11-11

Abstract:Autonomous robots combine a variety of skills to form increasingly complex behaviors called missions. While the skills are often programmed at a relatively low level of abstraction, their coordination is architecturally separated and often expressed in higher-level languages or frameworks. Recently, the language of Behavior Trees gained attention among roboticists for this reason. Originally designed for computer games to model autonomous actors, Behavior Trees offer an extensible tree-based representation of missions. However, even though, several implementations of the language are in use, little is known about its usage and scope in the real world. How do behavior trees relate to traditional languages for describing behavior? How are behavior tree concepts used in applications? What are the benefits of using them? We present a study of the key language concepts in Behavior Trees and their use in real-world robotic applications. We identify behavior tree languages and compare their semantics to the most well-known behavior modeling languages: state and activity diagrams. We mine open source repositories for robotics applications that use the language and analyze this usage. We find that Behavior Trees are a pragmatic language, not fully specified, allowing projects to extend it even for just one model. Behavior trees clearly resemble the models-at-runtime paradigm. We contribute a dataset of real-world behavior models, hoping to inspire the community to use and further develop this language, associated tools, and analysis techniques.

Robotics,Programming Languages,Software Engineering
Formalizing the Execution Context of Behavior Trees for Runtime Verification of Deliberative Policies

Michele Colledanchise,Giuseppe Cicala,Daniele E. Domenichelli,Lorenzo Natale,Armando Tacchella

DOI: https://doi.org/10.1109/IROS51168.2021.9636129

2021-09-16

Abstract:In this paper, we enable automated property verification of deliberative components in robot control architectures. We focus on formalizing the execution context of Behavior Trees (BTs) to provide a scalable, yet formally grounded, methodology to enable runtime verification and prevent unexpected robot behaviors. To this end, we consider a message-passing model that accommodates both synchronous and asynchronous composition of parallel components, in which BTs and other components execute and interact according to the communication patterns commonly adopted in robotic software architectures. We introduce a formal property specification language to encode requirements and build runtime monitors. We performed a set of experiments, both on simulations and on the real robot, demonstrating the feasibility of our approach in a realistic application and its integration in a typical robot software architecture. We also provide an OS-level virtualization environment to reproduce the experiments in the simulated scenario.

Robotics,Formal Languages and Automata Theory
On the programming effort required to generate Behavior Trees and Finite State Machines for robotic applications

Matteo Iovino,Julian Förster,Pietro Falco,Jen Jen Chung,Roland Siegwart,Christian Smith

DOI: https://doi.org/10.48550/arXiv.2209.07392

2022-09-15

Abstract:In this paper we provide a practical demonstration of how the modularity in a Behavior Tree (BT) decreases the effort in programming a robot task when compared to a Finite State Machine (FSM). In recent years the way to represent a task plan to control an autonomous agent has been shifting from the standard FSM towards BTs. Many works in the literature have highlighted and proven the benefits of such design compared to standard approaches, especially in terms of modularity, reactivity and human readability. However, these works have often failed in providing a tangible comparison in the implementation of those policies and the programming effort required to modify them. This is a relevant aspect in many robotic applications, where the design choice is dictated both by the robustness of the policy and by the time required to program it. In this work, we compare backward chained BTs with a fault-tolerant design of FSMs by evaluating the cost to modify them. We validate the analysis with a set of experiments in a simulation environment where a mobile manipulator solves an item fetching task.

Robotics
On the Implementation of Behavior Trees in Robotics

Michele Colledanchise,Lorenzo Natale

DOI: https://doi.org/10.1109/LRA.2021.3087442

2021-06-29

Abstract:There is a growing interest in Behavior Trees (BTs) as a tool to describe and implement robot behaviors. BTs were devised in the video game industry and their adoption in robotics resulted in the development of ad-hoc libraries to design and execute BTs that fit complex robotics software architectures. While there is broad consensus on how BTs work, some characteristics rely on the implementation choices done in the specific software library used. In this letter, we outline practical aspects in the adoption of BTs and the solutions devised by the robotics community to fully exploit the advantages of BTs in real robots. We also overview the solutions proposed in open-source libraries used in robotics, we show how BTs fit in robotic software architecture, and we present a use case example.

Robotics
Behavior Trees in Robotics and AI: An Introduction

Michele Colledanchise,Petter Ögren

DOI: https://doi.org/10.1201/9780429489105

2022-10-25

Abstract:A Behavior Tree (BT) is a way to structure the switching between different tasks in an autonomous agent, such as a robot or a virtual entity in a computer game. BTs are a very efficient way of creating complex systems that are both modular and reactive. These properties are crucial in many applications, which has led to the spread of BT from computer game programming to many branches of AI and Robotics. In this book, we will first give an introduction to BTs, then we describe how BTs relate to, and in many cases generalize, earlier switching structures. These ideas are then used as a foundation for a set of efficient and easy to use design principles. Properties such as safety, robustness, and efficiency are important for an autonomous system, and we describe a set of tools for formally analyzing these using a state space description of BTs. With the new analysis tools, we can formalize the descriptions of how BTs generalize earlier approaches. We also show the use of BTs in automated planning and machine learning. Finally, we describe an extended set of tools to capture the behavior of Stochastic BTs, where the outcomes of actions are described by probabilities. These tools enable the computation of both success probabilities and time to completion.

Robotics,Artificial Intelligence
Analysis and Exploitation of Synchronized Parallel Executions in Behavior Trees

Michele Colledanchise,Lorenzo Natale

DOI: https://doi.org/10.1109/IROS40897.2019.8967812

2019-08-05

Abstract:Behavior Trees (BTs) are becoming a popular tool to model the behaviors of autonomous agents in the computer game and the robotics industry. One of the key advantages of BTs lies in their composability, where complex behaviors can be built by composing simpler ones. The parallel composition is the one with the highest potential since the complexity of composing pre-existing behaviors in parallel is much lower than the one needed using classical control architectures as finite state machines. However, the parallel composition is rarely used due to the underlying concurrency problems that are similar to the ones faced in concurrent programming. In this paper, we define two synchronization techniques to tackle the concurrency problems in BTs compositions and we show how to exploit them to improve behavior predictability. Also, we introduce measures to assess execution performance, and we show how design choices can affect them. To illustrate the proposed framework, we provide a set of experiments using the R1 robot and we gather statistically-significant data.

Robotics
A Toolchain to Design, Execute, and Monitor Robots Behaviors

Michele Colledanchise,Giuseppe Cicala,Daniele E. Domenichelli,Lorenzo Natale,Armando Tacchella

DOI: https://doi.org/10.48550/arXiv.2106.15211

IF: 3.7

2021-06-29

Robotics

Abstract:In this paper, we present a toolchain to design, execute, and verify robot behaviors. The toolchain follows the guidelines defined by the EU H2020 project RobMoSys and encodes the robot deliberation as a Behavior Tree (BT), a directed tree where the internal nodes model behavior composition and leaf nodes model action or measurement operations. Such leaf nodes take the form of a statechart (SC), which runs in separate threads, whose states perform basic arithmetic operations and send commands to the robot. The toolchain provides the ability to define a runtime monitor for a given system specification that warns the user whenever a given specification is violated. We validated the toolchain in a simulated experiment that we made reproducible in an OS-virtualization environment.
Behavior Trees in Robot Control Systems

Petter Ögren,Christopher I. Sprague

DOI: https://doi.org/10.48550/arXiv.2203.13083

IF: 3.7

2022-03-24

Robotics

Abstract:In this paper we will give a control theoretic perspective on the research area of behavior trees in robotics. The key idea underlying behavior trees is to make use of modularity, hierarchies and feedback, in order to handle the complexity of a versatile robot control system. Modularity is a well-known tool to handle software complexity by enabling development, debugging and extension of separate modules without having detailed knowledge of the entire system. A hierarchy of such modules is natural, since robot tasks can often be decomposed into a hierarchy of sub-tasks. Finally, feedback control is a fundamental tool for handling uncertainties and disturbances in any low level control system, but in order to enable feedback control on the higher level, where one module decides what submodule to execute, information regarding progress and applicability of each submodule needs to be shared in the module interfaces. We will describe how these three concepts come to use in theoretical analysis, practical design, as well as extensions and combinations with other ideas from control theory and robotics.
Reconfigurable Behavior Trees: Towards an Executive Framework Meeting High-level Decision Making and Control Layer Features

Pilar de la Cruz,Justus Piater,Matteo Saveriano

DOI: https://doi.org/10.48550/arXiv.2007.10663

2020-08-31

Abstract:Behavior Trees constitute a widespread AI tool which has been successfully spun out in robotics. Their advantages include simplicity, modularity, and reusability of code. However, Behavior Trees remain a high-level decision making engine; control features cannot be easily integrated. This paper proposes the Reconfigurable Behavior Trees (RBTs), an extension of the traditional BTs that considers physical constraints from the robotic environment in the decision making process. We endow RBTs with continuous sensory information that permits the online monitoring of the task execution. The resulting stimulus-driven architecture is capable of dynamically handling changes in the executive context while keeping the execution time low. The proposed framework is evaluated on a set of robotic experiments. The results show that RBTs are a promising approach for robotic task representation, monitoring, and execution.

Robotics
Optimized Execution of PDDL Plans using Behavior Trees

Francisco Martín,Matteo Morelli,Huascar Espinoza,Francisco J. R. Lera,Vicente Matellán

DOI: https://doi.org/10.48550/arXiv.2101.01964

2021-01-11

Abstract:Robots need task planning to sequence and execute actions toward achieving their goals. On the other hand, Behavior Trees provide a mathematical model for specifying plan execution in an intrinsically composable, reactive, and robust way. PDDL (Planning Domain Definition Language) has become the standard description language for most planners. In this paper, we present a novel algorithm to systematically create behavior trees from PDDL plans to execute them. This approach uses the execution graph of the plan to generate a behavior tree. The most remarkable contribution of this approach is the algorithm to build a Behavior Tree that optimizes its execution by paralyzing actions, applicable to any plan, taking into account the actions' causal relationships. We demonstrate the improvement in the execution of plans in mobile robots using the ROS2 Planning System framework.

Robotics
Flexible Behavior Trees: In search of the mythical HFSMBTH for Collaborative Autonomy in Robotics

Joshua M. Zutell,David C. Conner,Philipp Schillinger

DOI: https://doi.org/10.48550/arXiv.2203.05389

2022-03-10

Abstract:In recent years, the model of computation known as Behavior Trees (BT), first developed in the video game industry, has become more popular in the robotics community for defining discrete behavior switching. BTs are threatening to supplant the venerable Hierarchical Finite State Machine (HFSM) model. In this paper we contrast BT and HFSM, pointing out some potential issues with the BT form, and advocate for a hybrid model of computation that uses both BT and HFSM in ways that leverage their individual strengths. The work introduces a new open-source package for ROS 2 that extends the Flexible Behavior Engine (FlexBE) to enable interaction with BT-based behaviors within a HFSM in a way that supports collaborative autonomy. Simulation and hardware demonstrations illustrate the concepts.

Robotics
Behavior Trees and State Machines in Robotics Applications

Razan Ghzouli,Thorsten Berger,Einar Broch Johnsen,Andrzej Wasowski,Swaib Dragule

DOI: https://doi.org/10.48550/arXiv.2208.04211

2023-03-06

Abstract:Autonomous robots combine skills to form increasingly complex behaviors, called missions. While skills are often programmed at a relatively low abstraction level, their coordination is architecturally separated and often expressed in higher-level languages or frameworks. State machines have been the go-to language to model behavior for decades, but recently, behavior trees have gained attention among roboticists. Although several implementations of behavior trees are in use, little is known about their usage and scope in the real <a class="link-external link-http" href="http://world.How" rel="external noopener nofollow">this http URL</a> do concepts offered by behavior trees relate to traditional languages, such as state machines? How are concepts in behavior trees and state machines used in actual applications? This paper is a study of the key language concepts in behavior trees as realized in domain-specific languages (DSLs), internal and external DSLs offered as libraries, and their use in open-source robotic applications supported by the Robot Operating System (ROS). We analyze behavior-tree DSLs and compare them to the standard language for behavior models in robotics:state machines. We identify DSLs for both behavior-modeling languages, and we analyze five <a class="link-external link-http" href="http://in-depth.We" rel="external noopener nofollow">this http URL</a> mine open-source repositories for robotic applications that use the analyzed DSLs and analyze their usage. We identify similarities between behavior trees and state machines in terms of language design and the concepts offered to accommodate the needs of the robotics domain. We observed that the usage of behavior-tree DSLs in open-source projects is increasing rapidly. We observed similar usage patterns at model structure and at code reuse in the behavior-tree and state-machine models within the mined open-source projects. We contribute all extracted models as a dataset, hoping to inspire the community to use and further develop behavior trees, associated tools, and analysis techniques.

Robotics,Software Engineering
Behavior Trees in Industrial Applications: A Case Study in Underground Explosive Charging

Mattias Hallen,Matteo Iovino,Shiva Sander-Tavallaey,Christian Smith

2024-03-29

Abstract:In industrial applications Finite State Machines (FSMs) are often used to implement decision making policies for autonomous systems. In recent years, the use of Behavior Trees (BT) as an alternative policy representation has gained considerable attention. The benefits of using BTs over FSMs are modularity and reusability, enabling a system that is easy to extend and modify. However, there exists few published studies on successful implementations of BTs for industrial applications. This paper contributes with the lessons learned from implementing BTs in a complex industrial use case, where a robotic system assembles explosive charges and places them in holes on the rock face. The main result of the paper is that even if it is possible to model the entire system as a BT, combining BTs with FSMs can increase the readability and maintainability of the system. The benefit of such combination is remarked especially in the use case studied in this paper, where the full system cannot run autonomously but human supervision and feedback are needed.

Robotics
Formalizing Stateful Behavior Trees

Serena S. Serbinowska,Preston Robinette,Gabor Karsai,Taylor T. Johnson

DOI: https://doi.org/10.4204/EPTCS.411.14

2024-11-21

Abstract:Behavior Trees (BTs) are high-level controllers that are useful in a variety of planning tasks and are gaining traction in robotic mission planning. As they gain popularity in safety-critical domains, it is important to formalize their syntax and semantics, as well as verify properties for them. In this paper, we formalize a class of BTs we call Stateful Behavior Trees (SBTs) that have auxiliary variables and operate in an environment that can change over time. SBTs have access to persistent shared memory (often known as a blackboard) that keeps track of these auxiliary variables. We demonstrate that SBTs are equivalent in computational power to Turing Machines when the blackboard can store mathematical (i.e., unbounded) integers. We further identify syntactic assumptions where SBTs have computational power equivalent to finite state automata, specifically where the auxiliary variables are of finitary types. We present a domain specific language (DSL) for writing SBTs and adapt the tool BehaVerify for use with this DSL. This new DSL in BehaVerify supports interfacing with popular BT libraries in Python, and also provides generation of Haskell code and nuXmv models, the latter of which is used for model checking temporal logic specifications for the SBTs. We include examples and scalability results where BehaVerify outperforms another verification tool by a factor of 100.

Robotics
Generalized Behavior Framework for Mobile Robots Teaming With Humans in Harsh Environments

Oliver Avram,Stefano Baraldo,Anna Valente

DOI: https://doi.org/10.3389/frobt.2022.898366

2022-06-29

Abstract:Industrial contexts, typically characterized by highly unstructured environments, where task sequences are difficult to hard-code and unforeseen events occur daily (e.g., oil and gas, energy generation, aeronautics) cannot completely rely upon automation to substitute the human dexterity and judgment skills. Robots operating in these conditions have the common requirement of being able to deploy appropriate behaviours in highly dynamic and unpredictable environments, while aiming to achieve a more natural human-robot interaction and a broad range of acceptability in providing useful and efficient services. The goal of this paper is to introduce a deliberative framework able to acquire, reuse and instantiate a collection of behaviours that promote an extension of the autonomy periods of mobile robotic platforms, with a focus on maintenance, repairing and overhaul applications. Behavior trees are employed to design the robotic system's high-level deliberative intelligence, which integrates: social behaviors, aiming to capture the human's emotional state and intention; the ability to either perform or support various process tasks; seamless planning and execution of human-robot shared work plans. In particular, the modularity, reactiveness and deliberation capacity that characterize the behaviour tree formalism are leveraged to interpret the human's health and cognitive load for supporting her/him, and to complete a shared mission by collaboration or complete take-over. By enabling mobile robotic platforms to take-over risky jobs which the human cannot, should not or do not want to perform the proposed framework bears high potential to significantly improve the safety, productivity and efficiency in harsh working environments.
An expressiveness hierarchy of Behavior Trees and related architectures

Oliver Biggar,Mohammad Zamani,Iman Shames

DOI: https://doi.org/10.48550/arXiv.2104.07919

2021-04-16

Abstract:In this paper we provide a formal framework for comparing the expressive power of Behavior Trees (BTs) to other action selection architectures. Taking inspiration from the analogous comparisons of structural programming methodologies, we formalise the concept of `expressiveness'. This leads us to an expressiveness hierarchy of control architectures, which includes BTs, Decision Trees (DTs), Teleo-reactive Programs (TRs) and Finite State Machines (FSMs). By distinguishing between BTs with auxiliary variables and those without, we demonstrate the existence of a trade-off in BT design between readability and expressiveness. We discuss what this means for BTs in practice.

Artificial Intelligence,Robotics
Learning and Executing Re-usable Behaviour Trees from Natural Language Instruction

Gavin Suddrey,Ben Talbot,Frederic Maire

DOI: https://doi.org/10.48550/arXiv.2106.01650

2021-06-03

Abstract:Domestic and service robots have the potential to transform industries such as health care and small-scale manufacturing, as well as the homes in which we live. However, due to the overwhelming variety of tasks these robots will be expected to complete, providing generic out-of-the-box solutions that meet the needs of every possible user is clearly intractable. To address this problem, robots must therefore not only be capable of learning how to complete novel tasks at run-time, but the solutions to these tasks must also be informed by the needs of the user. In this paper we demonstrate how behaviour trees, a well established control architecture in the fields of gaming and robotics, can be used in conjunction with natural language instruction to provide a robust and modular control architecture for instructing autonomous agents to learn and perform novel complex tasks. We also show how behaviour trees generated using our approach can be generalised to novel scenarios, and can be re-used in future learning episodes to create increasingly complex behaviours. We validate this work against an existing corpus of natural language instructions, demonstrate the application of our approach on both a simulated robot solving a toy problem, as well as two distinct real-world robot platforms which, respectively, complete a block sorting scenario, and a patrol scenario.

Robotics,Artificial Intelligence,Human-Computer Interaction
Handling Concurrency in Behavior Trees

Michele Colledanchise,Lorenzo Natale

DOI: https://doi.org/10.1109/TRO.2021.3125863

2021-10-22

Abstract:This paper addresses the concurrency issues affecting Behavior Trees (BTs), a popular tool to model the behaviors of autonomous agents in the video game and the robotics industry. BT designers can easily build complex behaviors composing simpler ones, which represents a key advantage of BTs. The parallel composition of BTs expresses a way to combine concurrent behaviors that has high potential, since composing pre-existing BTs in parallel results easier than composing in parallel classical control architectures, as finite state machines or teleo-reactive programs. However, BT designers rarely use such composition due to the underlying concurrency problems similar to the ones faced in concurrent programming. As a result, the parallel composition, despite its potential, finds application only in the composition of simple behaviors or where the designer can guarantee the absence of conflicts by design. In this paper, we define two new BT nodes to tackle the concurrency problems in BTs and we show how to exploit them to create predictable behaviors. In addition, we introduce measures to assess execution performance and show how different design choices affect them. We validate our approach in both simulations and the real world. Simulated experiments provide statistically significant data, whereas real-world experiments show the applicability of our method on real robots. We provided an open-source implementation of the novel BT formulation and published all the source code to reproduce the numerical examples and experiments.

Robotics
A Survey of Behavior Trees in Robotics and AI

Matteo Iovino,Edvards Scukins,Jonathan Styrud,Petter Ögren,Christian Smith

DOI: https://doi.org/10.48550/arXiv.2005.05842

2020-05-13

Abstract:Behavior Trees (BTs) were invented as a tool to enable modular AI in computer games, but have received an increasing amount of attention in the robotics community in the last decade. With rising demands on agent AI complexity, game programmers found that the Finite State Machines (FSM) that they used scaled poorly and were difficult to extend, adapt and reuse. In BTs, the state transition logic is not dispersed across the individual states, but organized in a hierarchical tree structure, with the states as leaves. This has a significant effect on modularity, which in turn simplifies both synthesis and analysis by humans and algorithms alike. These advantages are needed not only in game AI design, but also in robotics, as is evident from the research being done. In this paper we present a comprehensive survey of the topic of BTs in Artificial Intelligence and Robotic applications. The existing literature is described and categorized based on methods, application areas and contributions, and the paper is concluded with a list of open research challenges.

Robotics,Artificial Intelligence

Execution Semantics of Behavior Trees in Robotic Applications

A Resourceful Reframing of Behavior Trees

Behavior Trees in Action: A Study of Robotics Applications

Formalizing the Execution Context of Behavior Trees for Runtime Verification of Deliberative Policies

On the programming effort required to generate Behavior Trees and Finite State Machines for robotic applications

On the Implementation of Behavior Trees in Robotics

Behavior Trees in Robotics and AI: An Introduction

Analysis and Exploitation of Synchronized Parallel Executions in Behavior Trees

A Toolchain to Design, Execute, and Monitor Robots Behaviors

Behavior Trees in Robot Control Systems

Reconfigurable Behavior Trees: Towards an Executive Framework Meeting High-level Decision Making and Control Layer Features

Optimized Execution of PDDL Plans using Behavior Trees

Flexible Behavior Trees: In search of the mythical HFSMBTH for Collaborative Autonomy in Robotics

Behavior Trees and State Machines in Robotics Applications

Behavior Trees in Industrial Applications: A Case Study in Underground Explosive Charging

Formalizing Stateful Behavior Trees

Generalized Behavior Framework for Mobile Robots Teaming With Humans in Harsh Environments

An expressiveness hierarchy of Behavior Trees and related architectures

Learning and Executing Re-usable Behaviour Trees from Natural Language Instruction

Handling Concurrency in Behavior Trees

A Survey of Behavior Trees in Robotics and AI