Abstract:Background: Automated insulin delivery (AID) has represented a breakthrough in managing type 1 diabetes (T1D), showing safe and effective glucose control extensively across the board. However, metabolic variability still poses a challenge to commercial hybrid closed-loop (HCL) solutions, whose performance depends on customizable insulin therapy profiles. In this work, we propose an Identification-Replay-Optimization (IRO) approach to optimize gradually and safely such profiles for the Control-IQ AID algorithm. Methods: Closed-loop data are generated using the full adult cohort of the UVA/Padova T1D simulation platform in diverse glycemic scenarios. For each subject, daily records are processed and used to estimate a personalized model of the underlying insulin-glucose dynamics. Every two weeks, all identified models are integrated into an optimization procedure where daily basal and bolus profiles are adjusted so as to minimize the risks for hypo- and hyperglycemia. The proposed strategy is tested under different scenarios of metabolic and behavioral variability in order to evaluate the efficacy and convergence of the proposed strategy. Finally, glycemic metrics between cycles are compared using paired t-tests with p<0.05 as the significance threshold. Results: Simulations reveal that the proposed IRO approach was able to improve glucose control over time by safely mitigating the risks for both hypo- and hyperglycemia. Furthermore, smaller changes were recommended at each cycle, indicating convergence when simulation conditions were maintained. Conclusions: The use of reliable simulation-driven tools capable of accurately reproducing field-collected data and predicting changes can substantially shorten the process of optimizing insulin therapy, adjusting it to metabolic changes and leading to improved glucose control.

Auto adaptation of closed-loop insulin delivery system using continuous reward functions and incremental discretization

Continuous Drug Infusion for Diabetes Therapy: A Closed-Loop Control System Design

A Dual Mode Adaptive Basal-Bolus Advisor Based on Reinforcement Learning

Offline Deep Reinforcement Learning and Off-Policy Evaluation for Personalized Basal Insulin Control in Type 1 Diabetes

Reinforcement Learning-Based Adaptive Insulin Advisor for Individuals with Type 1 Diabetes Patients under Multiple Daily Injections Therapy

Data-enabled Learning and Control Algorithms for Intelligent Glucose Management: the State of the Art

Basal Glucose Control in Type 1 Diabetes Using Deep Reinforcement Learning: An In Silico Validation

An automatic deep reinforcement learning bolus calculator for automated insulin delivery systems

Basal-Bolus Advisor for Type 1 Diabetes (T1D) Patients Using Multi-Agent Reinforcement Learning (RL) Methodology

Offline reinforcement learning for safer blood glucose control in people with type 1 diabetes

Reinforcement Learning: A Paradigm Shift in Personalized Blood Glucose Management for Diabetes

An Insulin Bolus Advisor for Type 1 Diabetes Using Deep Reinforcement Learning

An Improved Strategy for Blood Glucose Control Using Multi-Step Deep Reinforcement Learning

Data-Driven Robust Reinforcement Learning Control of Uncertain Nonlinear Systems: Towards a Fully-Automated, Insulin-Based Artificial Pancreas

Data-Driven Robust Control for Type 1 Diabetes Under Meal and Exercise Uncertainties

Design of Robust Evolving Cloud-Based Controller for Type 1 Diabetic Patients Using n-Beats Algorithm

A Dual-Hormone Closed-Loop Delivery System for Type 1 Diabetes Using Deep Reinforcement Learning

Simulation-driven optimization of insulin therapy profiles in a commercial hybrid closed-loop system

Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

Blood glucose regulation in type 1 diabetic patients: an adaptive parametric compensation control‐based approach

Intermittent Control for Safe Long-Acting Insulin Intensification for Type 2 Diabetes: In-Silico Experiment