Cargando…

A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19

Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need fo...

Descripción completa

Detalles Bibliográficos
Autores principales: Shandhi, Md Mobashir Hasan, Cho, Peter J., Roghanizad, Ali R., Singh, Karnika, Wang, Will, Enache, Oana M., Stern, Amanda, Sbahi, Rami, Tatar, Bilge, Fiscus, Sean, Khoo, Qi Xuan, Kuo, Yvonne, Lu, Xiao, Hsieh, Joseph, Kalodzitsa, Alena, Bahmani, Amir, Alavi, Arash, Ray, Utsab, Snyder, Michael P., Ginsburg, Geoffrey S., Pasquale, Dana K., Woods, Christopher W., Shaw, Ryan J., Dunn, Jessilyn P.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9434073/
https://www.ncbi.nlm.nih.gov/pubmed/36050372
http://dx.doi.org/10.1038/s41746-022-00672-z
_version_ 1784780784971808768
author Shandhi, Md Mobashir Hasan
Cho, Peter J.
Roghanizad, Ali R.
Singh, Karnika
Wang, Will
Enache, Oana M.
Stern, Amanda
Sbahi, Rami
Tatar, Bilge
Fiscus, Sean
Khoo, Qi Xuan
Kuo, Yvonne
Lu, Xiao
Hsieh, Joseph
Kalodzitsa, Alena
Bahmani, Amir
Alavi, Arash
Ray, Utsab
Snyder, Michael P.
Ginsburg, Geoffrey S.
Pasquale, Dana K.
Woods, Christopher W.
Shaw, Ryan J.
Dunn, Jessilyn P.
author_facet Shandhi, Md Mobashir Hasan
Cho, Peter J.
Roghanizad, Ali R.
Singh, Karnika
Wang, Will
Enache, Oana M.
Stern, Amanda
Sbahi, Rami
Tatar, Bilge
Fiscus, Sean
Khoo, Qi Xuan
Kuo, Yvonne
Lu, Xiao
Hsieh, Joseph
Kalodzitsa, Alena
Bahmani, Amir
Alavi, Arash
Ray, Utsab
Snyder, Michael P.
Ginsburg, Geoffrey S.
Pasquale, Dana K.
Woods, Christopher W.
Shaw, Ryan J.
Dunn, Jessilyn P.
author_sort Shandhi, Md Mobashir Hasan
collection PubMed
description Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need for improving our current methods for mass surveillance testing. By targeting surveillance testing toward individuals who are most likely to be infected and, thus, increasing the testing positivity rate (i.e., percent positive in the surveillance group), fewer tests are needed to capture the same number of positive cases. Here, we developed an Intelligent Testing Allocation (ITA) method by leveraging data from the CovIdentify study (6765 participants) and the MyPHD study (8580 participants), including smartwatch data from 1265 individuals of whom 126 tested positive for COVID-19. Our rigorous model and parameter search uncovered the optimal time periods and aggregate metrics for monitoring continuous digital biomarkers to increase the positivity rate of COVID-19 diagnostic testing. We found that resting heart rate (RHR) features distinguished between COVID-19-positive and -negative cases earlier in the course of the infection than steps features, as early as 10 and 5 days prior to the diagnostic test, respectively. We also found that including steps features increased the area under the receiver operating characteristic curve (AUC-ROC) by 7–11% when compared with RHR features alone, while including RHR features improved the AUC of the ITA model’s precision-recall curve (AUC-PR) by 38–50% when compared with steps features alone. The best AUC-ROC (0.73 ± 0.14 and 0.77 on the cross-validated training set and independent test set, respectively) and AUC-PR (0.55 ± 0.21 and 0.24) were achieved by using data from a single device type (Fitbit) with high-resolution (minute-level) data. Finally, we show that ITA generates up to a 6.5-fold increase in the positivity rate in the cross-validated training set and up to a 4.5-fold increase in the positivity rate in the independent test set, including both symptomatic and asymptomatic (up to 27%) individuals. Our findings suggest that, if deployed on a large scale and without needing self-reported symptoms, the ITA method could improve the allocation of diagnostic testing resources and reduce the burden of test shortages.
format Online
Article
Text
id pubmed-9434073
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-94340732022-09-01 A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 Shandhi, Md Mobashir Hasan Cho, Peter J. Roghanizad, Ali R. Singh, Karnika Wang, Will Enache, Oana M. Stern, Amanda Sbahi, Rami Tatar, Bilge Fiscus, Sean Khoo, Qi Xuan Kuo, Yvonne Lu, Xiao Hsieh, Joseph Kalodzitsa, Alena Bahmani, Amir Alavi, Arash Ray, Utsab Snyder, Michael P. Ginsburg, Geoffrey S. Pasquale, Dana K. Woods, Christopher W. Shaw, Ryan J. Dunn, Jessilyn P. NPJ Digit Med Article Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need for improving our current methods for mass surveillance testing. By targeting surveillance testing toward individuals who are most likely to be infected and, thus, increasing the testing positivity rate (i.e., percent positive in the surveillance group), fewer tests are needed to capture the same number of positive cases. Here, we developed an Intelligent Testing Allocation (ITA) method by leveraging data from the CovIdentify study (6765 participants) and the MyPHD study (8580 participants), including smartwatch data from 1265 individuals of whom 126 tested positive for COVID-19. Our rigorous model and parameter search uncovered the optimal time periods and aggregate metrics for monitoring continuous digital biomarkers to increase the positivity rate of COVID-19 diagnostic testing. We found that resting heart rate (RHR) features distinguished between COVID-19-positive and -negative cases earlier in the course of the infection than steps features, as early as 10 and 5 days prior to the diagnostic test, respectively. We also found that including steps features increased the area under the receiver operating characteristic curve (AUC-ROC) by 7–11% when compared with RHR features alone, while including RHR features improved the AUC of the ITA model’s precision-recall curve (AUC-PR) by 38–50% when compared with steps features alone. The best AUC-ROC (0.73 ± 0.14 and 0.77 on the cross-validated training set and independent test set, respectively) and AUC-PR (0.55 ± 0.21 and 0.24) were achieved by using data from a single device type (Fitbit) with high-resolution (minute-level) data. Finally, we show that ITA generates up to a 6.5-fold increase in the positivity rate in the cross-validated training set and up to a 4.5-fold increase in the positivity rate in the independent test set, including both symptomatic and asymptomatic (up to 27%) individuals. Our findings suggest that, if deployed on a large scale and without needing self-reported symptoms, the ITA method could improve the allocation of diagnostic testing resources and reduce the burden of test shortages. Nature Publishing Group UK 2022-09-01 /pmc/articles/PMC9434073/ /pubmed/36050372 http://dx.doi.org/10.1038/s41746-022-00672-z Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Shandhi, Md Mobashir Hasan
Cho, Peter J.
Roghanizad, Ali R.
Singh, Karnika
Wang, Will
Enache, Oana M.
Stern, Amanda
Sbahi, Rami
Tatar, Bilge
Fiscus, Sean
Khoo, Qi Xuan
Kuo, Yvonne
Lu, Xiao
Hsieh, Joseph
Kalodzitsa, Alena
Bahmani, Amir
Alavi, Arash
Ray, Utsab
Snyder, Michael P.
Ginsburg, Geoffrey S.
Pasquale, Dana K.
Woods, Christopher W.
Shaw, Ryan J.
Dunn, Jessilyn P.
A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title_full A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title_fullStr A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title_full_unstemmed A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title_short A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
title_sort method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on covid-19
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9434073/
https://www.ncbi.nlm.nih.gov/pubmed/36050372
http://dx.doi.org/10.1038/s41746-022-00672-z
work_keys_str_mv AT shandhimdmobashirhasan amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT chopeterj amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT roghanizadalir amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT singhkarnika amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT wangwill amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT enacheoanam amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT sternamanda amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT sbahirami amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT tatarbilge amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT fiscussean amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT khooqixuan amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT kuoyvonne amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT luxiao amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT hsiehjoseph amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT kalodzitsaalena amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT bahmaniamir amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT alaviarash amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT rayutsab amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT snydermichaelp amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT ginsburggeoffreys amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT pasqualedanak amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT woodschristopherw amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT shawryanj amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT dunnjessilynp amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT shandhimdmobashirhasan methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT chopeterj methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT roghanizadalir methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT singhkarnika methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT wangwill methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT enacheoanam methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT sternamanda methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT sbahirami methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT tatarbilge methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT fiscussean methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT khooqixuan methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT kuoyvonne methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT luxiao methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT hsiehjoseph methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT kalodzitsaalena methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT bahmaniamir methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT alaviarash methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT rayutsab methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT snydermichaelp methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT ginsburggeoffreys methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT pasqualedanak methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT woodschristopherw methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT shawryanj methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19
AT dunnjessilynp methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19