Abstract:Hybrid electric vehicles (HEVs) rely on energy management strategies (EMSs) to achieve optimal fuel economy. However, both model- and learning-based EMSs have their respective limitations which negatively affect their performances in online applications. This paper presents a computationally efficient adaptive dynamic programming (ADP) approach that can not only rapidly calculate optimal control actions but also iteratively update the approximated value function (AVF) according to the actual fuel and electricity consumption with limited computation resources. Exploiting the AVF, the engine on/off switch and torque split problems are solved by one-step lookahead approximation and Pontryagin's minimum principle (PMP), respectively. To raise the training speed and reduce the memory space, the tabular value function (VF) is approximated by carefully selected piecewise polynomials via the parametric approximation. The advantages of the proposed EMS are threefold and verified by processor-in-the-loop (PIL) Monte Carlo simulations. First, the fuel efficiency of the proposed EMS is higher than that of an adaptive PMP and close to the theoretical optimum. Second, the new method can adapt to the changed driving conditions after a small number of learning iterations and thus has higher fuel efficiency than a non-adaptive dynamic programming (DP) controller. Third, the computation efficiencies of the proposed AVF and a tabular VF are compared. The concise data structure of the AVF enables faster convergence and saves at least $70\%$ of onboard memory space without obviously increasing the average CPU utilization.

Hamiltonian-Driven Hybrid Adaptive Dynamic Programming

Hamiltonian-driven Adaptive Dynamic Programming for Nonlinear Discrete-Time Dynamic Systems.

Hamiltonian-Driven Adaptive Dynamic Programming for Continuous Nonlinear Dynamical Systems

Hamiltonian-Driven Adaptive Dynamic Programming With Approximation Errors

Hamiltonian-Driven Adaptive Dynamic Programming With Efficient Experience Replay

A Parallel Framework of Adaptive Dynamic Programming Algorithm with Off-Policy Learning.

Hamiltonian‐driven Adaptive Dynamic Programming for Mixed H2/H∞ Performance Using Sum‐of‐squares

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

An Approximate Dynamic Programming Approach for Model-Free Control of Switched Systems.

Local Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems

Dynamic Energy Management for Hybrid Electric Vehicle Based on Adaptive Dynamic Programming

An Overview of Research on Adaptive Dynamic Programming

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Hamiltonian-Driven Adaptive Dynamic Programming Based on Extreme Learning Machine.

Continuous-time finite-horizon ADP for automated vehicle controller design with high efficiency

Event-triggered optimal decentralized control for stochastic interconnected nonlinear systems via adaptive dynamic programming

Model-Free Composite Control for a Class of Semi-Coupled Two-Time-Scale Systems: an Adaptive Dynamic Programming Approach

Action-dependent Heuristic Dynamic Programming for Hybrid-Order Systems Based on Dynamic Event-Triggered Mechanism

Constrained Decoupling Adaptive Dynamic Programming for A Partially Uncontrollable Time-Delayed Model of Energy Systems

Computationally Efficient Energy Management for a Parallel Hybrid Electric Vehicle Using Adaptive Dynamic Programming

Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration