Abstract:The linear quadratic regulator is a famous application of optimal control theory. This class of control systems has linear dynamics (in both the state and control), while minimizing a quadratic cost. Upon application of Pontryagin's maximum principle, the co-states can be fully decoupled from the state which results in a matrix Riccati equation. As such, solutions can be found by solving this matrix equation backwards. The purpose of this work is to extend this analysis to systems with linear state jumps, which are referred to as linear hybrid systems. The extension of the maximum principle to these systems results in the ``hybrid maximum principle.'' However, successful application of this theory requires many subtle properties which are usually ignored - specifically beating/blocking and Zeno. It turns out that these phenomena occur in linear hybrid systems and as such, the hybrid maximum principle is not immediately applicable to these seemingly simple systems. We show that for spatially triggered linear hybrid systems, beating always occurs while blocking and Zeno can be successfully avoided if a certain controllability assumption is satisfied. For these trivially blocking systems, we develop conditions for optimality for the two cases of when beating is excluded and present. This work concluded with an example.

An hybrid system approach to nonlinear optimal control problems

Optimal Control for Hybrid Systems Based on Mixed Dynamic Programming

On Modeling and Optimal Control of a Class of Hybrid Systems

Study on optimal control strategy for a class of piecewise linear hybrid systems

A hybrid model-based optimal control method for nonlinear systems using simultaneous dynamic optimization strategies

Optimal Control Of A Class Of Non-Linear Discrete-Continuous Hybrid Systems

Near Optimal Control for a Class of Stochastic Hybrid Systems.

Hybrid Optimal Control Problems for a Class of Semilinear Parabolic Equations

Costate prediction based optimal control for non-linear hybrid systems.

Optimal Nonlinear Dynamic Problem With Stochastic Impulse And Regular Control Laws

Approximate Optimal Hybrid Control Synthesis by Classification-Based Derivative-Free Optimization.

A derivative-free approach to optimal control problems with piecewise constant Mayer cost function

Optimal Control of State-Triggered Linear Hybrid Systems

Optimal Hybrid Control of Linear and Nonlinear Systems

An Approximate Dynamic Programming Approach for Model-Free Control of Switched Systems.

Sufficient Optimality Conditions for Hybrid Systems of Variable Dimension with Intermediate Constraints

Optimal Control of Discrete-Time Nonlinear Systems

Hybrid optimal control with mixed-integer Lagrangian methods

Regularity of Optimal Solutions and the Optimal Cost for Hybrid Dynamical Systems via Reachability Analysis

Optimal Control for Nonlinear Discrete-Time Systems: a Successive Approximation Approach.

Near-optimal control of nonlinear systems with hybrid inputs and dwell-time constraints