Abstract:Optimal control is seen by researchers from a different perspective than that from which the industry practitioners see it. Either type of user can easily become confounded when deciding which manner of optimal control should be used for guidance and control of mechanics. Such optimization methods are useful for autonomous navigation, guidance, and control, but their performance is hampered by noisy multi-sensor technologies and poorly modeled system equations, and real-time on-board utilization is generally computationally burdensome. Some methods proposed here use noisy sensor data to learn the optimal guidance and control solutions in real-time (online), where non-iterative instantiations are preferred to reduce computational burdens. This study aimed to highlight the efficacy and limitations of several common methods for optimizing guidance and control while proposing a few more, where all methods are applied to the full, nonlinear, coupled equations of motion including cross-products of motion from the transport theorem. While the reviewed literature introduces quantitative studies that include parametric uncertainty in nonlinear terms, this article proposes accommodating such uncertainty with time-varying solutions to Hamiltonian systems of equations solved in real-time. Five disparate types of optimum guidance and control algorithms are presented and compared to a classical benchmark. Comparative analysis is based on tracking errors (both states and rates), fuel usage, and computational burden. Real-time optimization with singular switching plus nonlinear transport theorem decoupling is newly introduced and proves superior by matching open-loop solutions to the constrained optimization problem (in terms of state and rate errors and fuel usage), while robustness is validated in the utilization of mixed, noisy state and rate sensors and uniformly varying mass and mass moments of inertia. Compared to benchmark, state-of-the-art methods state tracking errors are reduced one-hundred ten percent. Rate tracking errors are reduced one-hundred thirteen percent. Control utilization (fuel) is reduced eighty-four percent, while computational burden is reduced ten percent, simultaneously, where the proposed methods have no control gains and no linearization.

Optimal trading with online parameters revisions

Generalized Parameter Estimation Method for Model-Based Real Time Optimization

Parameter Optimization for Trading Algorithms of Technical Agents

Optimal execution of limit and market orders with trade director, speed limiter, and fill uncertainty

Neural Network Approaches for Parameterized Optimal Control

Model-Free Incremental Adaptive Dynamic Programming Based Approximate Robust Optimal Regulation

Online adaptation of controller parameters based on approximate dynamic programming

Algorithms for improving models of optimal control for multi-parametric technological processes based on artificial intelligence

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Treatise on Analytic Nonlinear Optimal Guidance and Control Amplification of Strictly Analytic (Non-Numerical) Methods

Online Non-stochastic Control with Partial Feedback

Online optimal consensus control of unknown linear multi-agent systems via time-based adaptive dynamic programming

Optimizing Automated Trading Systems with Deep Reinforcement Learning

A Dynamic Trading Model for Use with a One Step Ahead Optimal Strategy

Online convex optimization for robust control of constrained dynamical systems

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Be greedy and learn: efficient and certified algorithms for parametrized optimal control problems

Regret Optimal Control for Uncertain Stochastic Systems

Integrated Offline and Online Optimization-Based Control in a Base-Parallel Architecture

On Parametric Optimal Execution and Machine Learning Surrogates

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.