Skin spots and heart tumors.

T. Reddy,D. Eccles,J. Theaker,B. Keeton,K. Temple

DOI: https://doi.org/10.1067/MPD.2001.119595

IF: 2.99

2001-12-01

Jornal de Pediatria

Abstract:

What problem does this paper attempt to address?

The Safety Challenges of Deep Learning in Real-World Type 1 Diabetes Management

Harry Emerson,Ryan McConville,Matthew Guy

DOI: https://doi.org/10.48550/arXiv.2310.14743

IF: 5.414

2023-10-23

Machine Learning

Abstract:Blood glucose simulation allows the effectiveness of type 1 diabetes (T1D) management strategies to be evaluated without patient harm. Deep learning algorithms provide a promising avenue for extending simulator capabilities; however, these algorithms are limited in that they do not necessarily learn physiologically correct glucose dynamics and can learn incorrect and potentially dangerous relationships from confounders in training data. This is likely to be more important in real-world scenarios, as data is not collected under strict research protocol. This work explores the implications of using deep learning algorithms trained on real-world data to model glucose dynamics. Free-living data was processed from the OpenAPS Data Commons and supplemented with patient-reported tags of challenging diabetes events, constituting one of the most detailed real-world T1D datasets. This dataset was used to train and evaluate state-of-the-art glucose simulators, comparing their prediction error across safety critical scenarios and assessing the physiological appropriateness of the learned dynamics using Shapley Additive Explanations (SHAP). While deep learning prediction accuracy surpassed the widely-used mathematical simulator approach, the model deteriorated in safety critical scenarios and struggled to leverage self-reported meal and exercise information. SHAP value analysis also indicated the model had fundamentally confused the roles of insulin and carbohydrates, which is one of the most basic T1D management principles. This work highlights the importance of considering physiological appropriateness when using deep learning to model real-world systems in T1D and healthcare more broadly, and provides recommendations for building models that are robust to real-world data constraints.
Coumarins ofHeracleum asperum

S. Sergeeva,S. S. Kerimov

DOI: https://doi.org/10.1007/BF00577207

1982-03-01

Chemistry of Natural Compounds

Abstract:
Basal Glucose Control in Type 1 Diabetes Using Deep Reinforcement Learning: An In Silico Validation

Taiyu Zhu,Kezhi Li,Pau Herrero,Pantelis Georgiou

DOI: https://doi.org/10.1109/jbhi.2020.3014556

IF: 7.7

2021-04-01

IEEE Journal of Biomedical and Health Informatics

Abstract:People with Type 1 diabetes (T1D) require regular exogenous infusion of insulin to maintain their blood glucose concentration in a therapeutically adequate target range. Although the artificial pancreas and continuous glucose monitoring have been proven to be effective in achieving closed-loop control, significant challenges still remain due to the high complexity of glucose dynamics and limitations in the technology. In this work, we propose a novel deep reinforcement learning model for single-hormone (insulin) and dual-hormone (insulin and glucagon) delivery. In particular, the delivery strategies are developed by double Q-learning with dilated recurrent neural networks. For designing and testing purposes, the FDA-accepted UVA/Padova Type 1 simulator was employed. First, we performed long-term generalized training to obtain a population model. Then, this model was personalized with a small data-set of subject-specific data. In silico results show that the single and dual-hormone delivery strategies achieve good glucose control when compared to a standard basal-bolus therapy with low-glucose insulin suspension. Specifically, in the adult cohort (n = 10), percentage time in target range 70, 180 mg/dL improved from 77.6% to 80.9% with single-hormone control, and to 85.6% with dual-hormone control. In the adolescent cohort (n = 10), percentage time in target range improved from 55.5% to [Formula: see text] with single-hormone control, and to 78.8% with dual-hormone control. In all scenarios, a significant decrease in hypoglycemia was observed. These results show that the use of deep reinforcement learning is a viable approach for closed-loop glucose control in T1D.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
In-silico Risk Analysis of Personalized Artificial Pancreas Controllers via Rare-event Simulation

Matthew O'Kelly,Aman Sinha,Justin Norden,Hongseok Namkoong

DOI: https://doi.org/10.48550/arXiv.1812.00293

IF: 5.414

2018-12-02

Machine Learning

Abstract:Modern treatments for Type 1 diabetes (T1D) use devices known as artificial pancreata (APs), which combine an insulin pump with a continuous glucose monitor (CGM) operating in a closed-loop manner to control blood glucose levels. In practice, poor performance of APs (frequent hyper- or hypoglycemic events) is common enough at a population level that many T1D patients modify the algorithms on existing AP systems with unregulated open-source software. Anecdotally, the patients in this group have shown superior outcomes compared with standard of care, yet we do not understand how safe any AP system is since adverse outcomes are rare. In this paper, we construct generative models of individual patients' physiological characteristics and eating behaviors. We then couple these models with a T1D simulator approved for pre-clinical trials by the FDA. Given the ability to simulate patient outcomes in-silico, we utilize techniques from rare-event simulation theory in order to efficiently quantify the performance of a device with respect to a particular patient. We show a 72,000$\times$ speedup in simulation speed over real-time and up to 2-10 times increase in the frequency which we are able to sample adverse conditions relative to standard Monte Carlo sampling. In practice our toolchain enables estimates of the likelihood of hypoglycemic events with approximately an order of magnitude fewer simulations.
Learning Insulin-Glucose Dynamics in the Wild

Andrew C. Miller,Nicholas J. Foti,Emily Fox

DOI: https://doi.org/10.48550/arXiv.2008.02852

IF: 5.414

2020-08-06

Machine Learning

Abstract:We develop a new model of insulin-glucose dynamics for forecasting blood glucose in type 1 diabetics. We augment an existing biomedical model by introducing time-varying dynamics driven by a machine learning sequence model. Our model maintains a physiologically plausible inductive bias and clinically interpretable parameters -- e.g., insulin sensitivity -- while inheriting the flexibility of modern pattern recognition algorithms. Critical to modeling success are the flexible, but structured representations of subject variability with a sequence model. In contrast, less constrained models like the LSTM fail to provide reliable or physiologically plausible forecasts. We conduct an extensive empirical study. We show that allowing biomedical model dynamics to vary in time improves forecasting at long time horizons, up to six hours, and produces forecasts consistent with the physiological effects of insulin and carbohydrates.
Mapping data to virtual patients in type 1 diabetes

Patricio Colmegna,Ke Wang,Jose Garcia-Tirado,Marc D. Breton

DOI: https://doi.org/10.1016/j.conengprac.2020.104605

IF: 4.057

2020-10-01

Control Engineering Practice

Abstract:<p>In this work, a new approach to represent dynamic variations in type 1 diabetes (T1D) leveraging field-collected data (glucose monitor, insulin pump and meal records) is presented. The proposed methodology consists in identifying a time-invariant model structure of the glucose metabolism along with a variability component (VC) that captures daily changes in insulin sensitivity (IS). Performance is tested using both synthetic and real data, evidencing the ability of the methodology to replicate and predict outcomes under diverse conditions. This reconstruction-replay framework lays the foundation for a viable replay engine that can represent a powerful tool for precision medicine in T1D.</p>

automation & control systems,engineering, electrical & electronic
Differentiation of thymus and thymocytes. A study in foetal guinea-pigs using alkaline phosphatase as a label of thymocytes.

O. Ruuskanen,K. Kouvalainen

Immunology

Abstract:The differentiation of the guinea-pig thymus and thymocytes was studied using alkaline phosphatase (AP) as a marker of the thymocytes. The stem cell was assumed to be AP-negative. Cortical thymocytes contained a high activity of AP, which was lost or greatly diminished during the differentiation into medullary thymocytes and into T cells. Only approximately 1 per cent of the peripheral lymphocytes contained AP-activity. The role of these cells is obscure. In the morphological study three developmental stages were observed. At the beginning the AP-activity was concentrated in the periphery of the thymus anlage, and was first observed in a 23-day-old foetus. At about 28 days the foetal thymus contained homogeneously distributed AP-positive and AP-negative cells. The cortex and medulla began to differentiate at the age of 31–33 days and the definite differentiation formed the third developmental stage. Medulla achieved its maximal proportion at birth. The results are in agreement with earlier studies concerning the development of the guinea-pig thymus.
Learning Carbohydrate Digestion and Insulin Absorption Curves Using Blood Glucose Level Prediction and Deep Learning Models

Mario Muñoz-Organero,Paula Queipo-Álvarez,Boni García Gutiérrez

DOI: https://doi.org/10.3390/s21144926

IF: 3.9

2021-07-20

Sensors

Abstract:Type 1 diabetes is a chronic disease caused by the inability of the pancreas to produce insulin. Patients suffering type 1 diabetes depend on the appropriate estimation of the units of insulin they have to use in order to keep blood glucose levels in range (considering the calories taken and the physical exercise carried out). In recent years, machine learning models have been developed in order to help type 1 diabetes patients with their blood glucose control. These models tend to receive the insulin units used and the carbohydrate taken as inputs and generate optimal estimations for future blood glucose levels over a prediction horizon. The body glucose kinetics is a complex user-dependent process, and learning patient-specific blood glucose patterns from insulin units and carbohydrate content is a difficult task even for deep learning-based models. This paper proposes a novel mechanism to increase the accuracy of blood glucose predictions from deep learning models based on the estimation of carbohydrate digestion and insulin absorption curves for a particular patient. This manuscript proposes a method to estimate absorption curves by using a simplified model with two parameters which are fitted to each patient by using a genetic algorithm. Using simulated data, the results show the ability of the proposed model to estimate absorption curves with mean absolute errors below 0.1 for normalized fast insulin curves having a maximum value of 1 unit.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Approaches to Modeling Blood Glucose Dynamics In Type 1 Diabetic Patients for Insulin Pump Automation

Kirill V. Pozhar,Elizaveta A. Polyakova,Evgeniia L. Litinskaia,Aliona O. Ponomariova

DOI: https://doi.org/10.1109/elconrus54750.2022.9755551

2022-01-25

Abstract:With subcutaneous pump insulin therapy, due to the high delay in insulin action, it is necessary to predict the glucose dynamics. Model predictive control requires the development of sufficiently accurate mathematical models of blood glucose dynamics. The work considers the existing empirical, neural network-based, physiological-inspired and combined approaches to glucose modeling. We consider in detail the model used in the T1DMS simulator, which is a stiff system of nonlinear differential equations that includes a number of empirical dependencies. It describes the absorption of glucose during food intake, the dynamics of insulin and glucagon, the processes of utilization and general endogenous production of glucose. The paper proposes an approach to the description of glucose regulation processes, which consists in mapping the enzymes involved in catalysis and inhibition of glycolysis, gluconeogenesis, formation and degradation of glycogen, as well as in the application of the Michaelis-Menten equations for their description.
Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

Taku Yamagata,Aisling O'Kane,Amid Ayobi,Dmitri Katz,Katarzyna Stawarz,Paul Marshall,Peter Flach,Raúl Santos-Rodríguez

DOI: https://doi.org/10.48550/arXiv.2010.06266

IF: 5.414

2020-10-13

Machine Learning

Abstract:In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels combined with Model Predictive Controller for planning. Echo State Network is a version of recurrent neural networks which allows us to learn long term dependencies in the input of time series data in an online manner. Additionally, we address the quantification of uncertainty for a more robust control. Here, we used ensembles of Echo State Networks to capture model (epistemic) uncertainty. We evaluated the approach with the FDA-approved UVa/Padova Type 1 Diabetes simulator and compared the results against baseline algorithms such as Basal-Bolus controller and Deep Q-learning. The results suggest that the model-based reinforcement learning algorithm can perform equally or better than the baseline algorithms for the majority of virtual Type 1 Diabetes person profiles tested.
A statistical virtual patient population for the glucoregulatory system in type 1 diabetes with integrated exercise model

Navid Resalat,Joseph El Youssef,Nichole Tyler,Jessica Castle,Peter G. Jacobs

DOI: https://doi.org/10.1371/journal.pone.0217301

IF: 3.7

2019-07-25

PLoS ONE

Abstract:PURPOSE: We introduce two validated single (SH) and dual hormone (DH) mathematical models that represent an in-silico virtual patient population (VPP) for type 1 diabetes (T1D). The VPP can be used to evaluate automated insulin and glucagon delivery algorithms, so-called artificial pancreas (AP) algorithms that are currently being used to help people with T1D better manage their glucose levels. We present validation results comparing these virtual patients with true clinical patients undergoing AP control and demonstrate that the virtual patients behave similarly to people with T1D.METHODS: A single hormone virtual patient population (SH-VPP) was created that is comprised of eight differential equations that describe insulin kinetics, insulin dynamics and carbohydrate absorption. The parameters in this model that represent insulin sensitivity were statistically sampled from a normal distribution to create a population of virtual patients with different levels of insulin sensitivity. A dual hormone virtual patient population (DH-VPP) extended this SH-VPP by incorporating additional equations to represent glucagon kinetics and glucagon dynamics. The DH-VPP is comprised of thirteen differential equations and a parameter representing glucagon sensitivity, which was statistically sampled from a normal distribution to create virtual patients with different levels of glucagon sensitivity. We evaluated the SH-VPP and DH-VPP on a clinical data set of 20 people with T1D who participated in a 3.5-day outpatient AP study. Twenty virtual patients were matched with the 20 clinical patients by total daily insulin requirements and body weight. The identical meals given during the AP study were given to the virtual patients and the identical AP control algorithm that was used to control the glucose of the virtual patients was used on the clinical patients. We compared percent time in target range (70-180 mg/dL), time in hypoglycemia (<70 mg/dL) and time in hyperglycemia (>180 mg/dL) for both the virtual patients and the actual patients.RESULTS: The subjects in the SH-VPP performed similarly vs. the actual patients (time in range: 78.1 ± 5.1% vs. 74.3 ± 8.1%, p = 0.11; time in hypoglycemia: 3.4 ± 1.3% vs. 2.8 ± 1.7%, p = 0.23). The subjects in the DH-VPP also performed similarly vs. the actual patients (time in range: 75.6 ± 5.5% vs. 71.9 ± 10.9%, p = 0.13; time in hypoglycemia: 0.9 ± 0.8% vs. 1.3 ± 1%, p = 0.19). While the VPPs tended to over-estimate the time in range relative to actual patients, the difference was not statistically significant.CONCLUSIONS: We have verified that a SH-VPP and a DH-VPP performed comparably with actual patients undergoing AP control using an identical control algorithm. The SH-VPP and DH-VPP may be used as a simulator for pre-evaluation of T1D control algorithms.

multidisciplinary sciences
Deep transfer learning and data augmentation improve glucose levels prediction in type 2 diabetes patients

Yixiang Deng,Lu Lu,Laura Aponte,Angeliki M. Angelidi,Vera Novak,George Em Karniadakis,Christos S. Mantzoros

DOI: https://doi.org/10.1038/s41746-021-00480-x

IF: 15.2

2021-07-14

npj Digital Medicine

Abstract:Abstract Accurate prediction of blood glucose variations in type 2 diabetes (T2D) will facilitate better glycemic control and decrease the occurrence of hypoglycemic episodes as well as the morbidity and mortality associated with T2D, hence increasing the quality of life of patients. Owing to the complexity of the blood glucose dynamics, it is difficult to design accurate predictive models in every circumstance, i.e., hypo/normo/hyperglycemic events. We developed deep-learning methods to predict patient-specific blood glucose during various time horizons in the immediate future using patient-specific every 30-min long glucose measurements by the continuous glucose monitoring (CGM) to predict future glucose levels in 5 min to 1 h. In general, the major challenges to address are (1) the dataset of each patient is often too small to train a patient-specific deep-learning model, and (2) the dataset is usually highly imbalanced given that hypo- and hyperglycemic episodes are usually much less common than normoglycemia. We tackle these two challenges using transfer learning and data augmentation, respectively. We systematically examined three neural network architectures, different loss functions, four transfer-learning strategies, and four data augmentation techniques, including mixup and generative models. Taken together, utilizing these methodologies we achieved over 95% prediction accuracy and 90% sensitivity for a time period within the clinically useful 1 h prediction horizon that would allow a patient to react and correct either hypoglycemia and/or hyperglycemia. We have also demonstrated that the same network architecture and transfer-learning methods perform well for the type 1 diabetes OhioT1DM public dataset.

health care sciences & services,medical informatics
Simulation-driven optimization of insulin therapy profiles in a commercial hybrid closed-loop system

Jenny L Diaz C,María F Villa-Tamayo,Marcela Moscoso-Vasquez,Patricio Colmegna

DOI: https://doi.org/10.1016/j.cmpb.2023.107830

Abstract:Background: Automated insulin delivery (AID) has represented a breakthrough in managing type 1 diabetes (T1D), showing safe and effective glucose control extensively across the board. However, metabolic variability still poses a challenge to commercial hybrid closed-loop (HCL) solutions, whose performance depends on customizable insulin therapy profiles. In this work, we propose an Identification-Replay-Optimization (IRO) approach to optimize gradually and safely such profiles for the Control-IQ AID algorithm. Methods: Closed-loop data are generated using the full adult cohort of the UVA/Padova T1D simulation platform in diverse glycemic scenarios. For each subject, daily records are processed and used to estimate a personalized model of the underlying insulin-glucose dynamics. Every two weeks, all identified models are integrated into an optimization procedure where daily basal and bolus profiles are adjusted so as to minimize the risks for hypo- and hyperglycemia. The proposed strategy is tested under different scenarios of metabolic and behavioral variability in order to evaluate the efficacy and convergence of the proposed strategy. Finally, glycemic metrics between cycles are compared using paired t-tests with p<0.05 as the significance threshold. Results: Simulations reveal that the proposed IRO approach was able to improve glucose control over time by safely mitigating the risks for both hypo- and hyperglycemia. Furthermore, smaller changes were recommended at each cycle, indicating convergence when simulation conditions were maintained. Conclusions: The use of reliable simulation-driven tools capable of accurately reproducing field-collected data and predicting changes can substantially shorten the process of optimizing insulin therapy, adjusting it to metabolic changes and leading to improved glucose control.
An Insulin Bolus Advisor for Type 1 Diabetes Using Deep Reinforcement Learning

Taiyu Zhu,Kezhi Li,Lei Kuang,Pau Herrero,Pantelis Georgiou

DOI: https://doi.org/10.3390/s20185058

2020-09-06

Abstract:(1) Background: People living with type 1 diabetes (T1D) require self-management to maintain blood glucose (BG) levels in a therapeutic range through the delivery of exogenous insulin. However, due to the various variability, uncertainty and complex glucose dynamics, optimizing the doses of insulin delivery to minimize the risk of hyperglycemia and hypoglycemia is still an open problem. (2) Methods: In this work, we propose a novel insulin bolus advisor which uses deep reinforcement learning (DRL) and continuous glucose monitoring to optimize insulin dosing at mealtime. In particular, an actor-critic model based on deep deterministic policy gradient is designed to compute mealtime insulin doses. The proposed system architecture uses a two-step learning framework, in which a population model is first obtained and then personalized by subject-specific data. Prioritized memory replay is adopted to accelerate the training process in clinical practice. To validate the algorithm, we employ a customized version of the FDA-accepted UVA/Padova T1D simulator to perform in silico trials on 10 adult subjects and 10 adolescent subjects. (3) Results: Compared to a standard bolus calculator as the baseline, the DRL insulin bolus advisor significantly improved the average percentage time in target range (70-180 mg/dL) from 74.1%±8.4% to 80.9%±6.9% (p<0.01) and 54.9%±12.4% to 61.6%±14.1% (p<0.01) in the the adult and adolescent cohorts, respectively, while reducing hypoglycemia. (4) Conclusions: The proposed algorithm has the potential to improve mealtime bolus insulin delivery in people with T1D and is a feasible candidate for future clinical validation.
Automated Insulin Delivery for Type 1 Diabetes Mellitus Patients using Gaussian Process-based Model Predictive Control

Lukas Ortmann,Dawei Shi,Eyal Dassau,Francis J. Doyle,Berno J. E. Misgeld,Steffen Leonhardt,Francis J. Doyle III,Berno J.E. Misgeld

DOI: https://doi.org/10.48550/arXiv.2101.11887

2021-01-28

Systems and Control

Abstract:The human insulin-glucose metabolism is a time-varying process, which is partly caused by the changing insulin sensitivity of the body. This insulin sensitivity follows a circadian rhythm and its effects should be anticipated by any automated insulin delivery system. This paper presents an extension of our previous work on automated insulin delivery by developing a controller suitable for humans with Type 1 Diabetes Mellitus. Furthermore, we enhance the controller with a new kernel function for the Gaussian Process and deal with noisy measurements, as well as, the noisy training data for the Gaussian Process, arising therefrom. This enables us to move the proposed control algorithm, a combination of Model Predictive Controller and a Gaussian Process, closer towards clinical application. Simulation results on the University of Virginia/Padova FDA-accepted metabolic simulator are presented for a meal schedule with random carbohydrate sizes and random times of carbohydrate uptake to show the performance of the proposed control scheme.
Type 1 diabetes prevention clinical trial simulator: Case reports of model-informed drug development tool

Juan Francisco Morales,Marian Klose,Yannick Hoffert,Jagdeep T Podichetty,Jackson Burton,Stephan Schmidt,Klaus Romero,Inish O'Doherty,Frank Martin,Martha Campbell-Thompson,Michael J Haller,Mark A Atkinson,Sarah Kim

DOI: https://doi.org/10.1002/psp4.13193

Abstract:Clinical trials seeking to delay or prevent the onset of type 1 diabetes (T1D) face a series of pragmatic challenges. Despite more than 100 years since the discovery of insulin, teplizumab remains the only FDA-approved therapy to delay progression from Stage 2 to Stage 3 T1D. To increase the efficiency of clinical trials seeking this goal, our project sought to inform T1D clinical trial designs by developing a disease progression model-based clinical trial simulation tool. Using individual-level data collected from the TrialNet Pathway to Prevention and The Environmental Determinants of Diabetes in the Young natural history studies, we previously developed a quantitative joint model to predict the time to T1D onset. We then applied trial-specific inclusion/exclusion criteria, sample sizes in treatment and placebo arms, trial duration, assessment interval, and dropout rate. We implemented a function for presumed drug effects. To increase the size of the population pool, we generated virtual populations using multivariate normal distribution and ctree machine learning algorithms. As an output, power was calculated, which summarizes the probability of success, showing a statistically significant difference in the time distribution until the T1D diagnosis between the two arms. Using this tool, power curves can also be generated through iterations. The web-based tool is publicly available: https://app.cop.ufl.edu/t1d/. Herein, we briefly describe the tool and provide instructions for simulating a planned clinical trial with two case studies. This tool will allow for improved clinical trial designs and accelerate efforts seeking to prevent or delay the onset of T1D.
Modeling Physical Activity Impact on Glucose Dynamics in People with Type 1 Diabetes for a Fully Automated Artificial Pancreas

Mehrad Jaloli,Marzia Cescon

2023-07-16

Abstract:In this paper, models of the blood glucose (BG) dynamics in people with Type 1 diabetes (T1D) in response to moderate intensity aerobic activity are derived from physiology-based first principles and system identification experiments. We show that by enhancing insulin-dependent glucose utilization by the tissues in two phases, a rapid short-term increase in insulin-independent glucose clearance and augmented glucose uptake, and a long-term sustained increase sensitivity to insulin action, a metabolic model able to reproduce the effects of activity on glucose disposal is obtained. Second, a control-oriented transfer function model is proposed to predict the BG response to an exercise bout modeled as a step change in heart rate (HR). Results comparing model predictions with actual patients data collected in a series of experimental sessions including physical activity (PA) are presented. The findings will contribute to the design of a fully automated closed-loop for improved glucose control in conditions of daily life for people with T1D.

Systems and Control,Signal Processing,Computation
Evaluating Deep Q-Learning Algorithms for Controlling Blood Glucose in In Silico Type 1 Diabetes

Miguel Tejedor,Sigurd Nordtveit Hjerde,Jonas Nordhaug Myhre,Fred Godtliebsen

DOI: https://doi.org/10.3390/diagnostics13193150

IF: 3.6

2023-10-08

Diagnostics

Abstract:Patients with type 1 diabetes must continually decide how much insulin to inject before each meal to maintain blood glucose levels within a healthy range. Recent research has worked on a solution for this burden, showing the potential of reinforcement learning as an emerging approach for the task of controlling blood glucose levels. In this paper, we test and evaluate several deep Q-learning algorithms for automated and personalized blood glucose regulation in an in silico type 1 diabetes patient with the goal of estimating and delivering proper insulin doses. The proposed algorithms are model-free approaches with no prior information about the patient. We used the Hovorka model with meal variation and carbohydrate counting errors to simulate the patient included in this work. Our experiments compare different deep Q-learning extensions showing promising results controlling blood glucose levels, with some of the proposed algorithms outperforming standard baseline treatment.

medicine, general & internal
A Dual-Hormone Closed-Loop Delivery System for Type 1 Diabetes Using Deep Reinforcement Learning

Taiyu Zhu,Kezhi Li,Pantelis Georgiou

DOI: https://doi.org/10.48550/arXiv.1910.04059

2019-10-09

Quantitative Methods

Abstract:We propose a dual-hormone delivery strategy by exploiting deep reinforcement learning (RL) for people with Type 1 Diabetes (T1D). Specifically, double dilated recurrent neural networks (RNN) are used to learn the hormone delivery strategy, trained by a variant of Q-learning, whose inputs are raw data of glucose \& meal carbohydrate and outputs are dual-hormone (insulin and glucagon) delivery. Without prior knowledge of the glucose-insulin metabolism, we run the method on the UVA/Padova simulator. Hundreds days of self-play are performed to obtain a generalized model, then importance sampling is adopted to customize the model for personal use. \emph{In-silico} the proposed strategy achieves glucose time in target range (TIR) $93\%$ for adults and $83\%$ for adolescents given standard bolus, outperforming previous approaches significantly. The results indicate that deep RL is effective in building personalized hormone delivery strategy for people with T1D.
Deep learning and regression approaches to forecasting blood glucose levels for type 1 diabetes

Meng Zhang,Kevin B. Flores,Hien T. Tran

DOI: https://doi.org/10.1016/j.bspc.2021.102923

IF: 5.1

2021-08-01

Biomedical Signal Processing and Control

Abstract:<p>Objective: Controlling blood glucose in the euglycemic range is the main goal of developing the closed-loop insulin delivery system for type 1 diabetes patients. The closed-loop system delivers the amount of insulin dose determined by glucose predictions through the use of computational algorithms. A computationally efficient and accurate model that can capture the physiological nonlinear dynamics is critical for developing an efficient closed-loop system. Methods: Four data-driven models are compared, including different neural network architectures, a reservoir computing model, and a novel linear regression approach. Model predictions are evaluated over continuous 30 and 60 min time horizons using real-world data from wearable sensor measurements, a continuous glucose monitor, and self-reported events through mobile applications. The four data-driven models are trained on 12 data contributors for around 32 days, 8 days of data are used for validation, with an additional 10 days of data for out-of-sample testing. Model performance was evaluated by the root mean squared error and the mean absolute error. Results: A neural network model using an encoder-decoder architecture has the most stable performance and is able to recover missing dynamics in short time intervals. Regression models performed better at long-time prediction horizons (i.e., 60 min) and with lower computational costs. Significance: The performance of several distinct models was tested for individual-level data from a type 1 diabetes data set. These results may enable a feasible solution with low computational cost for the time-dependent adjustment of artificial pancreas for diabetes patients.</p>

engineering, biomedical

Skin spots and heart tumors.

The Safety Challenges of Deep Learning in Real-World Type 1 Diabetes Management

Coumarins ofHeracleum asperum

Basal Glucose Control in Type 1 Diabetes Using Deep Reinforcement Learning: An In Silico Validation

In-silico Risk Analysis of Personalized Artificial Pancreas Controllers via Rare-event Simulation

Learning Insulin-Glucose Dynamics in the Wild

Mapping data to virtual patients in type 1 diabetes

Differentiation of thymus and thymocytes. A study in foetal guinea-pigs using alkaline phosphatase as a label of thymocytes.

Learning Carbohydrate Digestion and Insulin Absorption Curves Using Blood Glucose Level Prediction and Deep Learning Models

Approaches to Modeling Blood Glucose Dynamics In Type 1 Diabetic Patients for Insulin Pump Automation

Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

A statistical virtual patient population for the glucoregulatory system in type 1 diabetes with integrated exercise model

Deep transfer learning and data augmentation improve glucose levels prediction in type 2 diabetes patients

Simulation-driven optimization of insulin therapy profiles in a commercial hybrid closed-loop system

An Insulin Bolus Advisor for Type 1 Diabetes Using Deep Reinforcement Learning

Automated Insulin Delivery for Type 1 Diabetes Mellitus Patients using Gaussian Process-based Model Predictive Control

Type 1 diabetes prevention clinical trial simulator: Case reports of model-informed drug development tool

Modeling Physical Activity Impact on Glucose Dynamics in People with Type 1 Diabetes for a Fully Automated Artificial Pancreas

Evaluating Deep Q-Learning Algorithms for Controlling Blood Glucose in In Silico Type 1 Diabetes

A Dual-Hormone Closed-Loop Delivery System for Type 1 Diabetes Using Deep Reinforcement Learning

Deep learning and regression approaches to forecasting blood glucose levels for type 1 diabetes