Cargando…
A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment
BACKGROUND: Fetal ultrasound is an important component of antenatal care, but shortage of adequately trained healthcare workers has limited its adoption in low-to-middle-income countries. This study investigated the use of artificial intelligence for fetal ultrasound in under-resourced settings. MET...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9553916/ https://www.ncbi.nlm.nih.gov/pubmed/36249461 http://dx.doi.org/10.1038/s43856-022-00194-5 |
_version_ | 1784806582992764928 |
---|---|
author | Gomes, Ryan G. Vwalika, Bellington Lee, Chace Willis, Angelica Sieniek, Marcin Price, Joan T. Chen, Christina Kasaro, Margaret P. Taylor, James A. Stringer, Elizabeth M. McKinney, Scott Mayer Sindano, Ntazana Dahl, George E. Goodnight, William Gilmer, Justin Chi, Benjamin H. Lau, Charles Spitz, Terry Saensuksopa, T. Liu, Kris Tiyasirichokchai, Tiya Wong, Jonny Pilgrim, Rory Uddin, Akib Corrado, Greg Peng, Lily Chou, Katherine Tse, Daniel Stringer, Jeffrey S. A. Shetty, Shravya |
author_facet | Gomes, Ryan G. Vwalika, Bellington Lee, Chace Willis, Angelica Sieniek, Marcin Price, Joan T. Chen, Christina Kasaro, Margaret P. Taylor, James A. Stringer, Elizabeth M. McKinney, Scott Mayer Sindano, Ntazana Dahl, George E. Goodnight, William Gilmer, Justin Chi, Benjamin H. Lau, Charles Spitz, Terry Saensuksopa, T. Liu, Kris Tiyasirichokchai, Tiya Wong, Jonny Pilgrim, Rory Uddin, Akib Corrado, Greg Peng, Lily Chou, Katherine Tse, Daniel Stringer, Jeffrey S. A. Shetty, Shravya |
author_sort | Gomes, Ryan G. |
collection | PubMed |
description | BACKGROUND: Fetal ultrasound is an important component of antenatal care, but shortage of adequately trained healthcare workers has limited its adoption in low-to-middle-income countries. This study investigated the use of artificial intelligence for fetal ultrasound in under-resourced settings. METHODS: Blind sweep ultrasounds, consisting of six freehand ultrasound sweeps, were collected by sonographers in the USA and Zambia, and novice operators in Zambia. We developed artificial intelligence (AI) models that used blind sweeps to predict gestational age (GA) and fetal malpresentation. AI GA estimates and standard fetal biometry estimates were compared to a previously established ground truth, and evaluated for difference in absolute error. Fetal malpresentation (non-cephalic vs cephalic) was compared to sonographer assessment. On-device AI model run-times were benchmarked on Android mobile phones. RESULTS: Here we show that GA estimation accuracy of the AI model is non-inferior to standard fetal biometry estimates (error difference −1.4 ± 4.5 days, 95% CI −1.8, −0.9, n = 406). Non-inferiority is maintained when blind sweeps are acquired by novice operators performing only two of six sweep motion types. Fetal malpresentation AUC-ROC is 0.977 (95% CI, 0.949, 1.00, n = 613), sonographers and novices have similar AUC-ROC. Software run-times on mobile phones for both diagnostic models are less than 3 s after completion of a sweep. CONCLUSIONS: The gestational age model is non-inferior to the clinical standard and the fetal malpresentation model has high AUC-ROCs across operators and devices. Our AI models are able to run on-device, without internet connectivity, and provide feedback scores to assist in upleveling the capabilities of lightly trained ultrasound operators in low resource settings. |
format | Online Article Text |
id | pubmed-9553916 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-95539162022-10-13 A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment Gomes, Ryan G. Vwalika, Bellington Lee, Chace Willis, Angelica Sieniek, Marcin Price, Joan T. Chen, Christina Kasaro, Margaret P. Taylor, James A. Stringer, Elizabeth M. McKinney, Scott Mayer Sindano, Ntazana Dahl, George E. Goodnight, William Gilmer, Justin Chi, Benjamin H. Lau, Charles Spitz, Terry Saensuksopa, T. Liu, Kris Tiyasirichokchai, Tiya Wong, Jonny Pilgrim, Rory Uddin, Akib Corrado, Greg Peng, Lily Chou, Katherine Tse, Daniel Stringer, Jeffrey S. A. Shetty, Shravya Commun Med (Lond) Article BACKGROUND: Fetal ultrasound is an important component of antenatal care, but shortage of adequately trained healthcare workers has limited its adoption in low-to-middle-income countries. This study investigated the use of artificial intelligence for fetal ultrasound in under-resourced settings. METHODS: Blind sweep ultrasounds, consisting of six freehand ultrasound sweeps, were collected by sonographers in the USA and Zambia, and novice operators in Zambia. We developed artificial intelligence (AI) models that used blind sweeps to predict gestational age (GA) and fetal malpresentation. AI GA estimates and standard fetal biometry estimates were compared to a previously established ground truth, and evaluated for difference in absolute error. Fetal malpresentation (non-cephalic vs cephalic) was compared to sonographer assessment. On-device AI model run-times were benchmarked on Android mobile phones. RESULTS: Here we show that GA estimation accuracy of the AI model is non-inferior to standard fetal biometry estimates (error difference −1.4 ± 4.5 days, 95% CI −1.8, −0.9, n = 406). Non-inferiority is maintained when blind sweeps are acquired by novice operators performing only two of six sweep motion types. Fetal malpresentation AUC-ROC is 0.977 (95% CI, 0.949, 1.00, n = 613), sonographers and novices have similar AUC-ROC. Software run-times on mobile phones for both diagnostic models are less than 3 s after completion of a sweep. CONCLUSIONS: The gestational age model is non-inferior to the clinical standard and the fetal malpresentation model has high AUC-ROCs across operators and devices. Our AI models are able to run on-device, without internet connectivity, and provide feedback scores to assist in upleveling the capabilities of lightly trained ultrasound operators in low resource settings. Nature Publishing Group UK 2022-10-11 /pmc/articles/PMC9553916/ /pubmed/36249461 http://dx.doi.org/10.1038/s43856-022-00194-5 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Gomes, Ryan G. Vwalika, Bellington Lee, Chace Willis, Angelica Sieniek, Marcin Price, Joan T. Chen, Christina Kasaro, Margaret P. Taylor, James A. Stringer, Elizabeth M. McKinney, Scott Mayer Sindano, Ntazana Dahl, George E. Goodnight, William Gilmer, Justin Chi, Benjamin H. Lau, Charles Spitz, Terry Saensuksopa, T. Liu, Kris Tiyasirichokchai, Tiya Wong, Jonny Pilgrim, Rory Uddin, Akib Corrado, Greg Peng, Lily Chou, Katherine Tse, Daniel Stringer, Jeffrey S. A. Shetty, Shravya A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title | A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title_full | A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title_fullStr | A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title_full_unstemmed | A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title_short | A mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
title_sort | mobile-optimized artificial intelligence system for gestational age and fetal malpresentation assessment |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9553916/ https://www.ncbi.nlm.nih.gov/pubmed/36249461 http://dx.doi.org/10.1038/s43856-022-00194-5 |
work_keys_str_mv | AT gomesryang amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT vwalikabellington amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT leechace amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT willisangelica amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT sieniekmarcin amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT pricejoant amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT chenchristina amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT kasaromargaretp amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT taylorjamesa amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT stringerelizabethm amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT mckinneyscottmayer amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT sindanontazana amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT dahlgeorgee amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT goodnightwilliam amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT gilmerjustin amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT chibenjaminh amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT laucharles amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT spitzterry amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT saensuksopat amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT liukris amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT tiyasirichokchaitiya amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT wongjonny amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT pilgrimrory amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT uddinakib amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT corradogreg amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT penglily amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT choukatherine amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT tsedaniel amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT stringerjeffreysa amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT shettyshravya amobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT gomesryang mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT vwalikabellington mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT leechace mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT willisangelica mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT sieniekmarcin mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT pricejoant mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT chenchristina mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT kasaromargaretp mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT taylorjamesa mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT stringerelizabethm mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT mckinneyscottmayer mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT sindanontazana mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT dahlgeorgee mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT goodnightwilliam mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT gilmerjustin mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT chibenjaminh mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT laucharles mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT spitzterry mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT saensuksopat mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT liukris mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT tiyasirichokchaitiya mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT wongjonny mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT pilgrimrory mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT uddinakib mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT corradogreg mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT penglily mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT choukatherine mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT tsedaniel mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT stringerjeffreysa mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment AT shettyshravya mobileoptimizedartificialintelligencesystemforgestationalageandfetalmalpresentationassessment |