Cargando…

Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study

BACKGROUND: An accurate prediction of mortality in end-of-life care is crucial but presents challenges. Existing prognostic tools demonstrate moderate performance in predicting survival across various time frames, primarily in in-hospital settings and single-time evaluations. However, these tools ma...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Jen-Hsuan, Shih, Chih-Yuan, Huang, Hsien-Liang, Peng, Jen-Kuei, Cheng, Shao-Yi, Tsai, Jaw-Shiun, Lai, Feipei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474512/
https://www.ncbi.nlm.nih.gov/pubmed/37594793
http://dx.doi.org/10.2196/47366
_version_ 1785100512445595648
author Liu, Jen-Hsuan
Shih, Chih-Yuan
Huang, Hsien-Liang
Peng, Jen-Kuei
Cheng, Shao-Yi
Tsai, Jaw-Shiun
Lai, Feipei
author_facet Liu, Jen-Hsuan
Shih, Chih-Yuan
Huang, Hsien-Liang
Peng, Jen-Kuei
Cheng, Shao-Yi
Tsai, Jaw-Shiun
Lai, Feipei
author_sort Liu, Jen-Hsuan
collection PubMed
description BACKGROUND: An accurate prediction of mortality in end-of-life care is crucial but presents challenges. Existing prognostic tools demonstrate moderate performance in predicting survival across various time frames, primarily in in-hospital settings and single-time evaluations. However, these tools may fail to capture the individualized and diverse trajectories of patients. Limited evidence exists regarding the use of artificial intelligence (AI) and wearable devices, specifically among patients with cancer at the end of life. OBJECTIVE: This study aimed to investigate the potential of using wearable devices and AI to predict death events among patients with cancer at the end of life. Our hypothesis was that continuous monitoring through smartwatches can offer valuable insights into the progression of patients at the end of life and enable the prediction of changes in their condition, which could ultimately enhance personalized care, particularly in outpatient or home care settings. METHODS: This prospective study was conducted at the National Taiwan University Hospital. Patients diagnosed with cancer and receiving end-of-life care were invited to enroll in wards, outpatient clinics, and home-based care settings. Each participant was given a smartwatch to collect physiological data, including steps taken, heart rate, sleep time, and blood oxygen saturation. Clinical assessments were conducted weekly. The participants were followed until the end of life or up to 52 weeks. With these input features, we evaluated the prediction performance of several machine learning–based classifiers and a deep neural network in 7-day death events. We used area under the receiver operating characteristic curve (AUROC), F(1)-score, accuracy, and specificity as evaluation metrics. A Shapley additive explanations value analysis was performed to further explore the models with good performance. RESULTS: From September 2021 to August 2022, overall, 1657 data points were collected from 40 patients with a median survival time of 34 days, with the detection of 28 death events. Among the proposed models, extreme gradient boost (XGBoost) yielded the best result, with an AUROC of 96%, F(1)-score of 78.5%, accuracy of 93%, and specificity of 97% on the testing set. The Shapley additive explanations value analysis identified the average heart rate as the most important feature. Other important features included steps taken, appetite, urination status, and clinical care phase. CONCLUSIONS: We demonstrated the successful prediction of patient deaths within the next 7 days using a combination of wearable devices and AI. Our findings highlight the potential of integrating AI and wearable technology into clinical end-of-life care, offering valuable insights and supporting clinical decision-making for personalized patient care. It is important to acknowledge that our study was conducted in a relatively small cohort; thus, further research is needed to validate our approach and assess its impact on clinical care. TRIAL REGISTRATION: ClinicalTrials.gov NCT05054907; https://classic.clinicaltrials.gov/ct2/show/NCT05054907
format Online
Article
Text
id pubmed-10474512
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-104745122023-09-03 Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study Liu, Jen-Hsuan Shih, Chih-Yuan Huang, Hsien-Liang Peng, Jen-Kuei Cheng, Shao-Yi Tsai, Jaw-Shiun Lai, Feipei J Med Internet Res Original Paper BACKGROUND: An accurate prediction of mortality in end-of-life care is crucial but presents challenges. Existing prognostic tools demonstrate moderate performance in predicting survival across various time frames, primarily in in-hospital settings and single-time evaluations. However, these tools may fail to capture the individualized and diverse trajectories of patients. Limited evidence exists regarding the use of artificial intelligence (AI) and wearable devices, specifically among patients with cancer at the end of life. OBJECTIVE: This study aimed to investigate the potential of using wearable devices and AI to predict death events among patients with cancer at the end of life. Our hypothesis was that continuous monitoring through smartwatches can offer valuable insights into the progression of patients at the end of life and enable the prediction of changes in their condition, which could ultimately enhance personalized care, particularly in outpatient or home care settings. METHODS: This prospective study was conducted at the National Taiwan University Hospital. Patients diagnosed with cancer and receiving end-of-life care were invited to enroll in wards, outpatient clinics, and home-based care settings. Each participant was given a smartwatch to collect physiological data, including steps taken, heart rate, sleep time, and blood oxygen saturation. Clinical assessments were conducted weekly. The participants were followed until the end of life or up to 52 weeks. With these input features, we evaluated the prediction performance of several machine learning–based classifiers and a deep neural network in 7-day death events. We used area under the receiver operating characteristic curve (AUROC), F(1)-score, accuracy, and specificity as evaluation metrics. A Shapley additive explanations value analysis was performed to further explore the models with good performance. RESULTS: From September 2021 to August 2022, overall, 1657 data points were collected from 40 patients with a median survival time of 34 days, with the detection of 28 death events. Among the proposed models, extreme gradient boost (XGBoost) yielded the best result, with an AUROC of 96%, F(1)-score of 78.5%, accuracy of 93%, and specificity of 97% on the testing set. The Shapley additive explanations value analysis identified the average heart rate as the most important feature. Other important features included steps taken, appetite, urination status, and clinical care phase. CONCLUSIONS: We demonstrated the successful prediction of patient deaths within the next 7 days using a combination of wearable devices and AI. Our findings highlight the potential of integrating AI and wearable technology into clinical end-of-life care, offering valuable insights and supporting clinical decision-making for personalized patient care. It is important to acknowledge that our study was conducted in a relatively small cohort; thus, further research is needed to validate our approach and assess its impact on clinical care. TRIAL REGISTRATION: ClinicalTrials.gov NCT05054907; https://classic.clinicaltrials.gov/ct2/show/NCT05054907 JMIR Publications 2023-08-18 /pmc/articles/PMC10474512/ /pubmed/37594793 http://dx.doi.org/10.2196/47366 Text en ©Jen-Hsuan Liu, Chih-Yuan Shih, Hsien-Liang Huang, Jen-Kuei Peng, Shao-Yi Cheng, Jaw-Shiun Tsai, Feipei Lai. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 18.08.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Liu, Jen-Hsuan
Shih, Chih-Yuan
Huang, Hsien-Liang
Peng, Jen-Kuei
Cheng, Shao-Yi
Tsai, Jaw-Shiun
Lai, Feipei
Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title_full Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title_fullStr Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title_full_unstemmed Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title_short Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study
title_sort evaluating the potential of machine learning and wearable devices in end-of-life care in predicting 7-day death events among patients with terminal cancer: cohort study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10474512/
https://www.ncbi.nlm.nih.gov/pubmed/37594793
http://dx.doi.org/10.2196/47366
work_keys_str_mv AT liujenhsuan evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT shihchihyuan evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT huanghsienliang evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT pengjenkuei evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT chengshaoyi evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT tsaijawshiun evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy
AT laifeipei evaluatingthepotentialofmachinelearningandwearabledevicesinendoflifecareinpredicting7daydeatheventsamongpatientswithterminalcancercohortstudy