Abstract:In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple online planning scenarios. However, these methods often overlook uncertainty in worst-case cost estimations. A system can fail to operate before achieving a critical objective when actual costs exceed optimistic worst-case estimates. Conversely, a system based on pessimistic worst-case estimates would lead to resource over-provisioning even for less critical objectives. To solve similar issues, the Mixed Criticality (MC) approach has been developed in the real-time systems community. In this paper, we propose to extend the MCTS heuristic in three directions. Firstly, we reformulate the concept of MC to account for uncertain worst-case costs. High-criticality tasks must be executed regardless of their uncertain costs. Low-criticality tasks are either executed in low-criticality mode utilizing resources up-to their optimistic worst-case estimates, or executed in high-criticality mode by degrading them, or discarded when resources are scarce. Secondly, although the MC approach was originally developed for real-time systems, focusing primarily on worst-case execution time as the only uncertain resource, our approach extends the concept of resources to deal with several resources at once, such as the time and energy required to perform an action. Finally, we propose an extension of MCTS with MC concepts, which we refer to as $(MC)^2TS$, to efficiently adjust resource allocation to uncertain costs according to the criticality of actions. We demonstrate our approach in an active perception scenario. Our evaluation shows $(MC)^2TS$ outperforms the traditional MCTS regardless of whether the worst case estimates are optimistic or pessimistic.

Augmenting Monte Carlo Tree Search for managing service level agreements

Efficient Dispatching for On-Demand Ride Services: Systematic Optimization Via Monte-Carlo Tree Search

Monte Carlo Tree Search in the Presence of Transition Uncertainty

Optimized Monte Carlo Tree Search for Enhanced Decision Making in the FrozenLake Environment

Monte Carlo Tree Search with Boltzmann Exploration

Monte Carlo Tree Search: a review of recent modifications and applications

An Analysis on the Effects of Evolving the Monte Carlo Tree Search Upper Confidence for Trees Selection Policy on Unimodal, Multimodal and Deceptive Landscapes

Playing Carcassonne with Monte Carlo Tree Search

Monte Carlo Tree Search for high precision manufacturing

Artificial intelligence-based inventory management: a Monte Carlo tree search approach

Elastic Monte Carlo Tree Search with State Abstraction for Strategy Game Playing

Towards Understanding the Effects of Evolving the MCTS UCT Selection Policy

Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne

Amplifying Exploration in Monte-Carlo Tree Search by Focusing on the Unknown

Dual Monte Carlo Tree Search

Surrogate Assisted Monte Carlo Tree Search in Combinatorial Optimization

Decision Making in Non-Stationary Environments with Policy-Augmented Monte Carlo Tree Search

Shackling Uncertainty using Mixed Criticality in Monte-Carlo Tree Search

Monte-Carlo tree search with uncertainty propagation via optimal transport

C-MCTS: Safe Planning with Monte Carlo Tree Search