Cargando…
Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning
Emergency departments (ED) in hospitals usually suffer from crowdedness and long waiting times for treatment. The complexity of the patient’s path flows and their controls come from the patient’s diverse acute level, personalized treatment process, and interconnected medical staff and resources. One...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7349722/ https://www.ncbi.nlm.nih.gov/pubmed/32230962 http://dx.doi.org/10.3390/healthcare8020077 |
_version_ | 1783557120685244416 |
---|---|
author | Lee, Seunghoon Lee, Young Hoon |
author_facet | Lee, Seunghoon Lee, Young Hoon |
author_sort | Lee, Seunghoon |
collection | PubMed |
description | Emergency departments (ED) in hospitals usually suffer from crowdedness and long waiting times for treatment. The complexity of the patient’s path flows and their controls come from the patient’s diverse acute level, personalized treatment process, and interconnected medical staff and resources. One of the factors, which has been controlled, is the dynamic situation change such as the patient’s composition and resources’ availability. The patient’s scheduling is thus complicated in consideration of various factors to achieve ED efficiency. To address this issue, a deep reinforcement learning (RL) is designed and applied in an ED patients’ scheduling process. Before applying the deep RL, the mathematical model and the Markov decision process (MDP) for the ED is presented and formulated. Then, the algorithm of the RL based on deep [Formula: see text]-networks (DQN) is designed to determine the optimal policy for scheduling patients. To evaluate the performance of the deep RL, it is compared with the dispatching rules presented in the study. The deep RL is shown to outperform the dispatching rules in terms of minimizing the weighted waiting time of the patients and the penalty of emergent patients in the suggested scenarios. This study demonstrates the successful implementation of the deep RL for ED applications, particularly in assisting decision-makers under the dynamic environment of an ED. |
format | Online Article Text |
id | pubmed-7349722 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-73497222020-07-15 Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning Lee, Seunghoon Lee, Young Hoon Healthcare (Basel) Article Emergency departments (ED) in hospitals usually suffer from crowdedness and long waiting times for treatment. The complexity of the patient’s path flows and their controls come from the patient’s diverse acute level, personalized treatment process, and interconnected medical staff and resources. One of the factors, which has been controlled, is the dynamic situation change such as the patient’s composition and resources’ availability. The patient’s scheduling is thus complicated in consideration of various factors to achieve ED efficiency. To address this issue, a deep reinforcement learning (RL) is designed and applied in an ED patients’ scheduling process. Before applying the deep RL, the mathematical model and the Markov decision process (MDP) for the ED is presented and formulated. Then, the algorithm of the RL based on deep [Formula: see text]-networks (DQN) is designed to determine the optimal policy for scheduling patients. To evaluate the performance of the deep RL, it is compared with the dispatching rules presented in the study. The deep RL is shown to outperform the dispatching rules in terms of minimizing the weighted waiting time of the patients and the penalty of emergent patients in the suggested scenarios. This study demonstrates the successful implementation of the deep RL for ED applications, particularly in assisting decision-makers under the dynamic environment of an ED. MDPI 2020-03-27 /pmc/articles/PMC7349722/ /pubmed/32230962 http://dx.doi.org/10.3390/healthcare8020077 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Lee, Seunghoon Lee, Young Hoon Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title | Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title_full | Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title_fullStr | Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title_full_unstemmed | Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title_short | Improving Emergency Department Efficiency by Patient Scheduling Using Deep Reinforcement Learning |
title_sort | improving emergency department efficiency by patient scheduling using deep reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7349722/ https://www.ncbi.nlm.nih.gov/pubmed/32230962 http://dx.doi.org/10.3390/healthcare8020077 |
work_keys_str_mv | AT leeseunghoon improvingemergencydepartmentefficiencybypatientschedulingusingdeepreinforcementlearning AT leeyounghoon improvingemergencydepartmentefficiencybypatientschedulingusingdeepreinforcementlearning |