Abstract:To develop cooperative adaptive cruise control (CACC), the choice of control approach often influences and can limit the choice of model structure, and vice versa. For heavy‐duty trucks, practical application of CACC in the field is heavily influenced by the accuracy of the used model. Deep learning and deep reinforcement learning (deep‐RL) have recently been used to demonstrate improved modeling and control performance for vehicles such as cars and quadrotors compared to state‐of‐the‐art. The literature on the application of deep learning and deep‐RL for heavy‐duty trucks in the field, which are significantly more complex than cars, is still sparse, however. In this article, we develop a two‐layer gray‐box deep learning model to capture longitudinal dynamics of heavy‐duty trucks while abstracting their complexity and present an approach to properly break the nested feedback loops in the model for training. We compare this model with three other alternative models and show that it achieves ~ 10 x better general performance compared to a standard artificial neural network and results in ~ 4 x and ~ 40 x slower steady‐state acceleration and speed error growth rates, respectively. We then present an architecture to utilize these deep learning models within the deep‐RL framework and use it to develop baseline CACC controllers that can be zero‐shot transferred to the field. To carry out the work, we present a setup of differently configured trucks along with their interface architecture and stochastic driving cycle generators for data collection. Numerical validation of the approach demonstrated stationary and bounded modeling error, and demonstrated transfer of CACC controllers with consistent overshoot bounds and a stable approximately‐zero steady‐state error. Validation from field experiments demonstrated similarly consistent results. Compared to a state‐of‐the‐art benchmark, the deep‐RL controller achieved lower speed and time‐gap error variance but higher time‐gap error offset.

Longitudinal Deep Truck: Deep learning and deep reinforcement learning for modeling and control of longitudinal dynamics of heavy duty trucks

Longitudinal deep truck: Deep longitudinal model with application to sim2real deep reinforcement learning for heavy‐duty truck control in the field

Lateral Dynamic Model for Full-Size Semi-Trailer Container Trucks with Practical Evaluation

Modelling And Control Of A Non-Linear Dynamic System For Heavy-Duty Trucks

Research on Modeling and Simulation of Longitudinal Control of Truck Autonomous Driving

Deep-Neural-Network-Based Modelling of Longitudinal-Lateral Dynamics to Predict the Vehicle States for Autonomous Driving

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Tactical Decision Making for Autonomous Trucks by Deep Reinforcement Learning with Total Cost of Operation Based Reward

Robust Longitudinal Control for Vehicular Autonomous Platoons Using Deep Reinforcement Learning

Human-like mechanism deep learning model for longitudinal motion control of autonomous vehicles

Autonomous driving of trucks in off-road environment

Longitudinal Dynamic versus Kinematic Models for Car-Following Control Using Deep Reinforcement Learning

Design of an omnidirectional, multi-axle, distributed-drive electric truck with Mecanum wheels and direct yaw moment controller

An integrated longitudinal and lateral control of vehicle platoons

Simulation and Experiment of Distributed Drive Hybrid Multi-Axle Heavy-Duty Truck Dynamics Control Algorithm

Multiple-Model Switching Control of Vehicle Longitudinal Dynamics for Platoon-Level Automation.

Aerodynamic optimization of a generic light truck under unsteady conditions using gradient-enriched machine learning control

Longitudinal Vehicle Dynamics: A Comparison of Physical and Data-Driven Models Under Large-Scale Real-World Driving Conditions

Online longitudinal trajectory planning for connected and autonomous vehicles in mixed traffic flow with deep reinforcement learning approach

Nonlinear Dynamic Modeling and Control of Low Speed Heavy-Duty Vehicles

Nonlinear modeling and identification of an autonomous tractor–trailer system