Abstract:This paper proposes a comprehensive hierarchical control framework for autonomous decision-making arising in robotics and autonomous systems. In a typical hierarchical control architecture, high-level decision making is often characterised by discrete state and decision/control sets. However, a rational decision is usually affected by not only the discrete states of the autonomous system, but also the underlying continuous dynamics even the evolution of its operational environment. This paper proposes a holistic and comprehensive design process and framework for this type of challenging problems, from new modelling and design problem formulation to control design and stability analysis. It addresses the intricate interplay between traditional continuous systems dynamics utilized at the low levels for control design and discrete Markov decision processes (MDP) for facilitating high-level decision making. We model the decision making system in complex environments as a hybrid system consisting of a controlled MDP and autonomous (i.e. uncontrolled) continuous dynamics. Consequently, the new formulation is called as hybrid Markov decision process (HMDP). The design problem is formulated with a focus on ensuring both safety and optimality while taking into account the influence of both the discrete and continuous state variables of different levels. With the help of the model predictive control (MPC) concept, a decision maker design scheme is proposed for the proposed hybrid decision making model. By carefully designing key ingredients involved in this scheme, it is shown that the recursive feasibility and stability of the proposed autonomous decision making scheme are guaranteed. The proposed framework is applied to develop an autonomous lane changing system for intelligent vehicles.

Hierarchical Control Models for Multimodal Process Modeling

Hierarchical group process representation in multi-agent activity recognition

Hierarchical Complex Activity Representation and Recognition Using Topic Model and Classifier Level Fusion.

Multi-Hierarchical Model Predictive Control Based on K-Means Clustering Algorithms

Research on multi-mode MPC based on clustering multi-modeling

Hierarchical Bayesian Network Modeling Framework for Large-Scale Process Monitoring and Decision Making.

Research on Model Switching Method of Multi-hierarchical Model Predictive Control System

A hierarchical control framework for autonomous decision-making systems: Integrating HMDP and MPC

HCMS: Hierarchical and Conditional Modality Selection for Efficient Video Recognition

Seeing "what" Through "why": Evidence from Probing the Causal Structure of Hierarchical Motion.

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

A conceptual modeling framework for discrete event simulation using hierarchical control structures

Hierarchical Multi-Observation Model for Multi-Person Activity Recognition

Hyperbolic Interaction Model For Hierarchical Multi-Label Classification

A Hierarchical Spatio-Temporal Model for Human Activity Recognition.

A cross modal hierarchical fusion multimodal sentiment analysis method based on multi-task learning

Decomposition In Hidden Markov Models For Activity Recognition

CSM-H-R: A Context Modeling Framework in Supporting Reasoning Automation for Interoperable Intelligent Systems and Privacy Protection

Emotion recognition based on brain-like multimodal hierarchical perception

Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning

Hierarchical Interacting Multiple Model Algorithm Based on Improved Current Model