Abstract:We consider a class of learning problem of point estimation for modeling high-dimensional nonlinear functions, whose learning dynamics is guided by model training dataset, while the estimated parameter in due course provides an acceptable prediction accuracy on a different model validation dataset. Here, we establish an evidential connection between such a learning problem and a hierarchical optimal control problem that provides a framework how to account appropriately for both generalization and regularization at the optimization stage. In particular, we consider the following two objectives: (i) The first one is a controllability-type problem, i.e., generalization, which consists of guaranteeing the estimated parameter to reach a certain target set at some fixed final time, where such a target set is associated with model validation dataset. (ii) The second one is a regularization-type problem ensuring the estimated parameter trajectory to satisfy some regularization property over a certain finite time interval. First, we partition the control into two control strategies that are compatible with two abstract agents, namely, a leader, which is responsible for the controllability-type problem and that of a follower, which is associated with the regularization-type problem. Using the notion of Stackelberg's optimization, we provide conditions on the existence of admissible optimal controls for such a hierarchical optimal control problem under which the follower is required to respond optimally to the strategy of the leader, so as to achieve the overall objectives that ultimately leading to an optimal parameter estimate. Moreover, we provide a nested algorithm, arranged in a hierarchical structure-based on successive approximation methods, for solving the corresponding optimal control problem. Finally, we present some numerical results for a typical nonlinear regression problem.

Optimal Control and Filtering for Hierarchical Decision Problems with $H_{\infty }$ Constraint based on Stackelberg Strategy

Robust H∞ controller design of large-scale discrete-time overlapping systems

Three-Level Multi-Leader-Follower Incentive Stackelberg Differential Game with $H_\infty$ Constraint

On the hierarchical optimal control of a chain of distributed systems

Adaptive dynamic programming-based hierarchical decision-making of non-affine systems

Hierarchical Optimal Synchronization for Linear Systems Via Reinforcement Learning: A Stackelberg–Nash Game Perspective

Two-Player Stackelberg Game for Linear System Via Value Iteration Algorithm

Hierarchical control for the semilinear parabolic equations with interior degeneracy

A successive approximation method in functional spaces for hierarchical optimal control problems and its application to learning

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

A hierarchical control framework for autonomous decision-making systems: Integrating HMDP and MPC

Hierarchical control problem for the heat equation with dynamic boundary conditions

Hierarchical Control for the Oldroyd Equation in Memoriam to Professor Luiz Adauto Medeiros

Sensitivity-based Hierarchical Distributed Model Predictive Control of Nonlinear Processes

Backward Stackelberg Differential Game with Constraints: a Mixed Terminal-Perturbation and Linear-Quadratic Approach

Output-feedback Q-learning for discrete-time linear H-infinity tracking control: A Stackelberg game approach

Sliding-mode surface-based approximate optimal control for nonlinear multiplayer Stackelberg-Nash games via adaptive dynamic programming

Output‐feedback Q‐learning for discrete‐time linear <i>H</i><sup>∞</sup> tracking control: A Stackelberg game approach

Dynamic Programming Approach to Discrete Time Dynamic Feedback Stackelberg Games with Independent and Dependent Followers.

A Hierarchical Learning Solution for Anti-Jamming Stackelberg Game with Discrete Power Strategies

Stackelberg-Nash null controllability for stochastic parabolic equations