Cargando…

Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning

Diabetes mellitus is a disease associated with abnormally high levels of blood glucose due to a lack of insulin. Combining an insulin pump and continuous glucose monitor with a control algorithm to deliver insulin is an alternative to patient self-management of insulin doses to control blood glucose...

Descripción completa

Detalles Bibliográficos
Autores principales: Viroonluecha, Phuwadol, Egea-Lopez, Esteban, Santa, Jose
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9469983/
https://www.ncbi.nlm.nih.gov/pubmed/36099285
http://dx.doi.org/10.1371/journal.pone.0274608
_version_ 1784788751774384128
author Viroonluecha, Phuwadol
Egea-Lopez, Esteban
Santa, Jose
author_facet Viroonluecha, Phuwadol
Egea-Lopez, Esteban
Santa, Jose
author_sort Viroonluecha, Phuwadol
collection PubMed
description Diabetes mellitus is a disease associated with abnormally high levels of blood glucose due to a lack of insulin. Combining an insulin pump and continuous glucose monitor with a control algorithm to deliver insulin is an alternative to patient self-management of insulin doses to control blood glucose levels in diabetes mellitus patients. In this work, we propose a closed-loop control for blood glucose levels based on deep reinforcement learning. We describe the initial evaluation of several alternatives conducted on a realistic simulator of the glucoregulatory system and propose a particular implementation strategy based on reducing the frequency of the observations and rewards passed to the agent, and using a simple reward function. We train agents with that strategy for three groups of patient classes, evaluate and compare it with alternative control baselines. Our results show that our method is able to outperform baselines as well as similar recent proposals, by achieving longer periods of safe glycemic state and low risk.
format Online
Article
Text
id pubmed-9469983
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-94699832022-09-14 Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning Viroonluecha, Phuwadol Egea-Lopez, Esteban Santa, Jose PLoS One Research Article Diabetes mellitus is a disease associated with abnormally high levels of blood glucose due to a lack of insulin. Combining an insulin pump and continuous glucose monitor with a control algorithm to deliver insulin is an alternative to patient self-management of insulin doses to control blood glucose levels in diabetes mellitus patients. In this work, we propose a closed-loop control for blood glucose levels based on deep reinforcement learning. We describe the initial evaluation of several alternatives conducted on a realistic simulator of the glucoregulatory system and propose a particular implementation strategy based on reducing the frequency of the observations and rewards passed to the agent, and using a simple reward function. We train agents with that strategy for three groups of patient classes, evaluate and compare it with alternative control baselines. Our results show that our method is able to outperform baselines as well as similar recent proposals, by achieving longer periods of safe glycemic state and low risk. Public Library of Science 2022-09-13 /pmc/articles/PMC9469983/ /pubmed/36099285 http://dx.doi.org/10.1371/journal.pone.0274608 Text en © 2022 Viroonluecha et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Viroonluecha, Phuwadol
Egea-Lopez, Esteban
Santa, Jose
Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title_full Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title_fullStr Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title_full_unstemmed Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title_short Evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
title_sort evaluation of blood glucose level control in type 1 diabetic patients using deep reinforcement learning
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9469983/
https://www.ncbi.nlm.nih.gov/pubmed/36099285
http://dx.doi.org/10.1371/journal.pone.0274608
work_keys_str_mv AT viroonluechaphuwadol evaluationofbloodglucoselevelcontrolintype1diabeticpatientsusingdeepreinforcementlearning
AT egealopezesteban evaluationofbloodglucoselevelcontrolintype1diabeticpatientsusingdeepreinforcementlearning
AT santajose evaluationofbloodglucoselevelcontrolintype1diabeticpatientsusingdeepreinforcementlearning