Abstract:This work introduces a novel paradigm for solving optimal control problems for hybrid dynamical systems under uncertainties. Robotic systems having contact with the environment can be modeled as hybrid systems. Controller design for hybrid systems under disturbances is complicated by the discontinuous jump dynamics, mode changes with inconsistent state dimensions, and variations in jumping timing and states caused by noise. We formulate this problem into a stochastic control problem with hybrid transition constraints and propose the Hybrid Path Integral (H-PI) framework to obtain the optimal controller. Despite random mode changes across stochastic path samples, we show that the ratio between hybrid path distributions with varying drift terms remains analogous to the smooth path distributions. We then show that the optimal controller can be obtained by evaluating a path integral with hybrid constraints. Importance sampling for path distributions with hybrid dynamics constraints is introduced to reduce the variance of the path integral evaluation, where we leverage the recently developed Hybrid iterative-Linear-Quadratic-Regulator (H-iLQR) controller to induce a hybrid path distribution proposal with low variance. The proposed method is validated through numerical experiments on various hybrid systems and extensive ablation studies. All the sampling processes are conducted in parallel on a Graphics Processing Unit (GPU).

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

Study on optimal control strategy for a class of piecewise linear hybrid systems

On Modeling and Optimal Control of a Class of Hybrid Systems

Optimal Control of Hybrid Systems Based on Dynamic Programming

Optimal control of a class of hybrid systems with states and inputs constraints

AN APPROACH TO MULTI-OBJECTIVE OPTIMAL CONTROL PROBLEMS FOR HYBRID DYNAMIC SYSTEMS

A hybrid model-based optimal control method for nonlinear systems using simultaneous dynamic optimization strategies

Optimal Control Of A Class Of Non-Linear Discrete-Continuous Hybrid Systems

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Mixed Integer Programming Based Optimization of a Class of Hybrid Systems

Optimal Control of Switched Hybrid Systems

An integrated state space partition and optimal control method of multi-model for nonlinear systems based on hybrid systems

Optimal control for a class of hybrid systems in manufacturing

Path Integral Control for Hybrid Dynamical Systems

Intelligent Optimal Control of Constrained Nonlinear Systems Via Receding-Horizon Heuristic Dynamic Programming

On the Relation between the Minimum Principle and Dynamic Programming for Classical and Hybrid Control Systems

Costate prediction based optimal control for non-linear hybrid systems.

The Optimal Control Problem Of Markov Multi-Model Hybrid System

An Approximate Dynamic Programming Approach for Model-Free Control of Switched Systems.

Optimal control of intelligent vehicle longitudinal dynamics via hybrid model predictive control

An hybrid system approach to nonlinear optimal control problems