Abstract:The suspension system is a crucial part of the automotive chassis, improving vehicle ride comfort and isolating passengers from rough road excitation. Unlike passive suspension, which has constant spring and damping coefficients, active suspension incorporates electronic actuators into the system to dynamically control stiffness and damping variables. However, effectively controlling the suspension system poses a challenging task that necessitates real-time adaptability to various road conditions. This paper presents the Physics-Guided Deep Reinforcement Learning (DRL) for adjusting an active suspension system's variable kinematics and compliance properties for a quarter-car model in real time. Specifically, the outputs of the model are defined as actuator stiffness and damping control, which are bound within physically realistic ranges to maintain the system's physical compliance. The proposed model was trained on stochastic road profiles according to ISO 8608 standards to optimize the actuator's control policy. According to qualitative results on simulations, the vehicle body reacts smoothly to various novel real-world road conditions, having a much lower degree of oscillation. These observations mean a higher level of passenger comfort and better vehicle stability. Quantitatively, DRL outperforms passive systems in reducing the average vehicle body velocity and acceleration by 43.58% and 17.22%, respectively, minimizing the vertical movement impacts on the passengers. The code is publicly available at <a class="link-external link-http" href="http://github.com/anh-nn01/RL4Suspension-ICMLA23" rel="external noopener nofollow">this http URL</a>.

DDPG Based Self-Learning Active and Model-Constrained Semi-Active Suspension Control

Integrated Model Predictive Control and Adaptive Unscented Kalman Filter for Semi-Active Suspension System Based on Road Classification

Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay

Ride Comfort Improvement with Preview Control Semi-active Suspension System Based on Supervised Deep Learning

Reinforcement-Learning-Based Vibration Control for a Vehicle Semi-Active Suspension System via the PPO Approach

A deep reinforcement learning-based active suspension control algorithm considering deterministic experience tracing for autonomous vehicle

Physics-Guided Reinforcement Learning System for Realistic Vehicle Active Suspension Control

Fast Distributed Model Predictive Control Method for Active Suspension Systems

Semi-Active Suspension Adaptive Control Strategy Based on Hybrid Control

Reinforcement Learning-Based Vibration Control for Half-Car Active Suspension Considering Unknown Dynamics and Preset Convergence Rate

A Sliding Mode Semi-Active Control for Suspension Based on Neural Network

Experimental Study of Road Identification by LSTM with Application to Adaptive Suspension Damping Control

Model reference backstepping control for semi-active air suspension systems with parameter uncertainty

Hybrid model predictive control on lifting and dropping vehicle body via asymmetric damping adjustment

Active Suspension Control of Quarter-Car System With Experimental Validation

A novel DNFS control strategy for vehicle semi-active suspension system

Adaptive optimal control system design for semi-active suspension system by supposing variable parameters under exogenous road disturbance

Neural networks-based adaptive dynamic surface control for vehicle active suspension systems with time-varying displacement constraints

Switching Control of Semi-Active Suspension Based on Road Profile Estimation

Nonlinear Damping Curve Control of Semi-Active Suspension Based on Improved Particle Swarm Optimization

Ride comfort improvement by back propagation-active disturbance rejection control in semi-active hydro-pneumatic suspension of mining dump truck