Abstract:This work introduces a novel paradigm for solving optimal control problems for hybrid dynamical systems under uncertainties. Robotic systems having contact with the environment can be modeled as hybrid systems. Controller design for hybrid systems under disturbances is complicated by the discontinuous jump dynamics, mode changes with inconsistent state dimensions, and variations in jumping timing and states caused by noise. We formulate this problem into a stochastic control problem with hybrid transition constraints and propose the Hybrid Path Integral (H-PI) framework to obtain the optimal controller. Despite random mode changes across stochastic path samples, we show that the ratio between hybrid path distributions with varying drift terms remains analogous to the smooth path distributions. We then show that the optimal controller can be obtained by evaluating a path integral with hybrid constraints. Importance sampling for path distributions with hybrid dynamics constraints is introduced to reduce the variance of the path integral evaluation, where we leverage the recently developed Hybrid iterative-Linear-Quadratic-Regulator (H-iLQR) controller to induce a hybrid path distribution proposal with low variance. The proposed method is validated through numerical experiments on various hybrid systems and extensive ablation studies. All the sampling processes are conducted in parallel on a Graphics Processing Unit (GPU).

A "Hybrid" Approach for Synthesizing Optimal Controllers of Hybrid Systems: A Case Study of the Oil Pump Industrial Example

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

On Modeling and Optimal Control of a Class of Hybrid Systems

Study on optimal control strategy for a class of piecewise linear hybrid systems

Data-driven Direct Automatic Tuning Scheme for Fixed-Structure Digital Controllers of Hybrid Systems

AN APPROACH TO MULTI-OBJECTIVE OPTIMAL CONTROL PROBLEMS FOR HYBRID DYNAMIC SYSTEMS

Efficient Hybrid Strategy for Simultaneous Design of Refinery Hydrogen Networks and Pressure Swing Adsorption Unit

Approximate Optimal Hybrid Control Synthesis by Classification-Based Derivative-Free Optimization.

Optimal Control of Hybrid Systems Based on Dynamic Programming

A hybrid model-based optimal control method for nonlinear systems using simultaneous dynamic optimization strategies

Automatic Synthesis of Robust and Optimal Controllers --- An Industrial Case Study

An hybrid system approach to nonlinear optimal control problems

Automatic Control Software Synthesis for Quantized Discrete Time Hybrid Systems

Optimal Control Of A Class Of Non-Linear Discrete-Continuous Hybrid Systems

Hybrid Controller Synthesis for Nonlinear Systems Subject to Reach-Avoid Constraints.

Optimal and Robust Controller Synthesis Using Energytimed Automata with Uncertainty

Hybrid optimal control with mixed-integer Lagrangian methods

Optimal Solution, Quantitative Performance Estimation, and Robust Tuning of the Simplifying Controller

Path Integral Control for Hybrid Dynamical Systems

Flexible Computational Pipelines for Robust Abstraction-Based Control Synthesis

An Approximate Dynamic Programming Approach for Model-Free Control of Switched Systems.