Cargando…
A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19
Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need fo...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9434073/ https://www.ncbi.nlm.nih.gov/pubmed/36050372 http://dx.doi.org/10.1038/s41746-022-00672-z |
_version_ | 1784780784971808768 |
---|---|
author | Shandhi, Md Mobashir Hasan Cho, Peter J. Roghanizad, Ali R. Singh, Karnika Wang, Will Enache, Oana M. Stern, Amanda Sbahi, Rami Tatar, Bilge Fiscus, Sean Khoo, Qi Xuan Kuo, Yvonne Lu, Xiao Hsieh, Joseph Kalodzitsa, Alena Bahmani, Amir Alavi, Arash Ray, Utsab Snyder, Michael P. Ginsburg, Geoffrey S. Pasquale, Dana K. Woods, Christopher W. Shaw, Ryan J. Dunn, Jessilyn P. |
author_facet | Shandhi, Md Mobashir Hasan Cho, Peter J. Roghanizad, Ali R. Singh, Karnika Wang, Will Enache, Oana M. Stern, Amanda Sbahi, Rami Tatar, Bilge Fiscus, Sean Khoo, Qi Xuan Kuo, Yvonne Lu, Xiao Hsieh, Joseph Kalodzitsa, Alena Bahmani, Amir Alavi, Arash Ray, Utsab Snyder, Michael P. Ginsburg, Geoffrey S. Pasquale, Dana K. Woods, Christopher W. Shaw, Ryan J. Dunn, Jessilyn P. |
author_sort | Shandhi, Md Mobashir Hasan |
collection | PubMed |
description | Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need for improving our current methods for mass surveillance testing. By targeting surveillance testing toward individuals who are most likely to be infected and, thus, increasing the testing positivity rate (i.e., percent positive in the surveillance group), fewer tests are needed to capture the same number of positive cases. Here, we developed an Intelligent Testing Allocation (ITA) method by leveraging data from the CovIdentify study (6765 participants) and the MyPHD study (8580 participants), including smartwatch data from 1265 individuals of whom 126 tested positive for COVID-19. Our rigorous model and parameter search uncovered the optimal time periods and aggregate metrics for monitoring continuous digital biomarkers to increase the positivity rate of COVID-19 diagnostic testing. We found that resting heart rate (RHR) features distinguished between COVID-19-positive and -negative cases earlier in the course of the infection than steps features, as early as 10 and 5 days prior to the diagnostic test, respectively. We also found that including steps features increased the area under the receiver operating characteristic curve (AUC-ROC) by 7–11% when compared with RHR features alone, while including RHR features improved the AUC of the ITA model’s precision-recall curve (AUC-PR) by 38–50% when compared with steps features alone. The best AUC-ROC (0.73 ± 0.14 and 0.77 on the cross-validated training set and independent test set, respectively) and AUC-PR (0.55 ± 0.21 and 0.24) were achieved by using data from a single device type (Fitbit) with high-resolution (minute-level) data. Finally, we show that ITA generates up to a 6.5-fold increase in the positivity rate in the cross-validated training set and up to a 4.5-fold increase in the positivity rate in the independent test set, including both symptomatic and asymptomatic (up to 27%) individuals. Our findings suggest that, if deployed on a large scale and without needing self-reported symptoms, the ITA method could improve the allocation of diagnostic testing resources and reduce the burden of test shortages. |
format | Online Article Text |
id | pubmed-9434073 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-94340732022-09-01 A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 Shandhi, Md Mobashir Hasan Cho, Peter J. Roghanizad, Ali R. Singh, Karnika Wang, Will Enache, Oana M. Stern, Amanda Sbahi, Rami Tatar, Bilge Fiscus, Sean Khoo, Qi Xuan Kuo, Yvonne Lu, Xiao Hsieh, Joseph Kalodzitsa, Alena Bahmani, Amir Alavi, Arash Ray, Utsab Snyder, Michael P. Ginsburg, Geoffrey S. Pasquale, Dana K. Woods, Christopher W. Shaw, Ryan J. Dunn, Jessilyn P. NPJ Digit Med Article Mass surveillance testing can help control outbreaks of infectious diseases such as COVID-19. However, diagnostic test shortages are prevalent globally and continue to occur in the US with the onset of new COVID-19 variants and emerging diseases like monkeypox, demonstrating an unprecedented need for improving our current methods for mass surveillance testing. By targeting surveillance testing toward individuals who are most likely to be infected and, thus, increasing the testing positivity rate (i.e., percent positive in the surveillance group), fewer tests are needed to capture the same number of positive cases. Here, we developed an Intelligent Testing Allocation (ITA) method by leveraging data from the CovIdentify study (6765 participants) and the MyPHD study (8580 participants), including smartwatch data from 1265 individuals of whom 126 tested positive for COVID-19. Our rigorous model and parameter search uncovered the optimal time periods and aggregate metrics for monitoring continuous digital biomarkers to increase the positivity rate of COVID-19 diagnostic testing. We found that resting heart rate (RHR) features distinguished between COVID-19-positive and -negative cases earlier in the course of the infection than steps features, as early as 10 and 5 days prior to the diagnostic test, respectively. We also found that including steps features increased the area under the receiver operating characteristic curve (AUC-ROC) by 7–11% when compared with RHR features alone, while including RHR features improved the AUC of the ITA model’s precision-recall curve (AUC-PR) by 38–50% when compared with steps features alone. The best AUC-ROC (0.73 ± 0.14 and 0.77 on the cross-validated training set and independent test set, respectively) and AUC-PR (0.55 ± 0.21 and 0.24) were achieved by using data from a single device type (Fitbit) with high-resolution (minute-level) data. Finally, we show that ITA generates up to a 6.5-fold increase in the positivity rate in the cross-validated training set and up to a 4.5-fold increase in the positivity rate in the independent test set, including both symptomatic and asymptomatic (up to 27%) individuals. Our findings suggest that, if deployed on a large scale and without needing self-reported symptoms, the ITA method could improve the allocation of diagnostic testing resources and reduce the burden of test shortages. Nature Publishing Group UK 2022-09-01 /pmc/articles/PMC9434073/ /pubmed/36050372 http://dx.doi.org/10.1038/s41746-022-00672-z Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Shandhi, Md Mobashir Hasan Cho, Peter J. Roghanizad, Ali R. Singh, Karnika Wang, Will Enache, Oana M. Stern, Amanda Sbahi, Rami Tatar, Bilge Fiscus, Sean Khoo, Qi Xuan Kuo, Yvonne Lu, Xiao Hsieh, Joseph Kalodzitsa, Alena Bahmani, Amir Alavi, Arash Ray, Utsab Snyder, Michael P. Ginsburg, Geoffrey S. Pasquale, Dana K. Woods, Christopher W. Shaw, Ryan J. Dunn, Jessilyn P. A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title | A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title_full | A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title_fullStr | A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title_full_unstemmed | A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title_short | A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19 |
title_sort | method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on covid-19 |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9434073/ https://www.ncbi.nlm.nih.gov/pubmed/36050372 http://dx.doi.org/10.1038/s41746-022-00672-z |
work_keys_str_mv | AT shandhimdmobashirhasan amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT chopeterj amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT roghanizadalir amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT singhkarnika amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT wangwill amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT enacheoanam amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT sternamanda amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT sbahirami amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT tatarbilge amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT fiscussean amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT khooqixuan amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT kuoyvonne amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT luxiao amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT hsiehjoseph amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT kalodzitsaalena amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT bahmaniamir amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT alaviarash amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT rayutsab amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT snydermichaelp amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT ginsburggeoffreys amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT pasqualedanak amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT woodschristopherw amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT shawryanj amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT dunnjessilynp amethodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT shandhimdmobashirhasan methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT chopeterj methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT roghanizadalir methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT singhkarnika methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT wangwill methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT enacheoanam methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT sternamanda methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT sbahirami methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT tatarbilge methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT fiscussean methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT khooqixuan methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT kuoyvonne methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT luxiao methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT hsiehjoseph methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT kalodzitsaalena methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT bahmaniamir methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT alaviarash methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT rayutsab methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT snydermichaelp methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT ginsburggeoffreys methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT pasqualedanak methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT woodschristopherw methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT shawryanj methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 AT dunnjessilynp methodforintelligentallocationofdiagnostictestingbyleveragingdatafromcommercialwearabledevicesacasestudyoncovid19 |