Cargando…

Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries

Most artificial intelligence (AI) research and innovations have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in...

Descripción completa

Detalles Bibliográficos
Autores principales: Sendra-Balcells, Carla, Campello, Víctor M., Torrents-Barrena, Jordina, Ahmed, Yahya Ali, Elattar, Mustafa, Ohene-Botwe, Benard, Nyangulu, Pempho, Stones, William, Ammar, Mohammed, Benamer, Lamya Nawal, Kisembo, Harriet Nalubega, Sereke, Senai Goitom, Wanyonyi, Sikolia Z., Temmerman, Marleen, Gratacós, Eduard, Bonet, Elisenda, Eixarch, Elisenda, Mikolaj, Kamil, Tolsgaard, Martin Grønnebæk, Lekadir, Karim
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932015/
https://www.ncbi.nlm.nih.gov/pubmed/36792642
http://dx.doi.org/10.1038/s41598-023-29490-3
_version_ 1784889355096031232
author Sendra-Balcells, Carla
Campello, Víctor M.
Torrents-Barrena, Jordina
Ahmed, Yahya Ali
Elattar, Mustafa
Ohene-Botwe, Benard
Nyangulu, Pempho
Stones, William
Ammar, Mohammed
Benamer, Lamya Nawal
Kisembo, Harriet Nalubega
Sereke, Senai Goitom
Wanyonyi, Sikolia Z.
Temmerman, Marleen
Gratacós, Eduard
Bonet, Elisenda
Eixarch, Elisenda
Mikolaj, Kamil
Tolsgaard, Martin Grønnebæk
Lekadir, Karim
author_facet Sendra-Balcells, Carla
Campello, Víctor M.
Torrents-Barrena, Jordina
Ahmed, Yahya Ali
Elattar, Mustafa
Ohene-Botwe, Benard
Nyangulu, Pempho
Stones, William
Ammar, Mohammed
Benamer, Lamya Nawal
Kisembo, Harriet Nalubega
Sereke, Senai Goitom
Wanyonyi, Sikolia Z.
Temmerman, Marleen
Gratacós, Eduard
Bonet, Elisenda
Eixarch, Elisenda
Mikolaj, Kamil
Tolsgaard, Martin Grønnebæk
Lekadir, Karim
author_sort Sendra-Balcells, Carla
collection PubMed
description Most artificial intelligence (AI) research and innovations have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa, the rate of perinatal mortality is very high due to limited access to antenatal screening. In these countries, AI models could be implemented to help clinicians acquire fetal ultrasound planes for the diagnosis of fetal abnormalities. So far, deep learning models have been proposed to identify standard fetal planes, but there is no evidence of their ability to generalise in centres with low resources, i.e. with limited access to high-end ultrasound equipment and ultrasound data. This work investigates for the first time different strategies to reduce the domain-shift effect arising from a fetal plane classification model trained on one clinical centre with high-resource settings and transferred to a new centre with low-resource settings. To that end, a classifier trained with 1792 patients from Spain is first evaluated on a new centre in Denmark in optimal conditions with 1008 patients and is later optimised to reach the same performance in five African centres (Egypt, Algeria, Uganda, Ghana and Malawi) with 25 patients each. The results show that a transfer learning approach for domain adaptation can be a solution to integrate small-size African samples with existing large-scale databases in developed countries. In particular, the model can be re-aligned and optimised to boost the performance on African populations by increasing the recall to [Formula: see text] and at the same time maintaining a high precision across centres. This framework shows promise for building new AI models generalisable across clinical centres with limited data acquired in challenging and heterogeneous conditions and calls for further research to develop new solutions for the usability of AI in countries with fewer resources and, consequently, in higher need of clinical support.
format Online
Article
Text
id pubmed-9932015
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-99320152023-02-17 Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries Sendra-Balcells, Carla Campello, Víctor M. Torrents-Barrena, Jordina Ahmed, Yahya Ali Elattar, Mustafa Ohene-Botwe, Benard Nyangulu, Pempho Stones, William Ammar, Mohammed Benamer, Lamya Nawal Kisembo, Harriet Nalubega Sereke, Senai Goitom Wanyonyi, Sikolia Z. Temmerman, Marleen Gratacós, Eduard Bonet, Elisenda Eixarch, Elisenda Mikolaj, Kamil Tolsgaard, Martin Grønnebæk Lekadir, Karim Sci Rep Article Most artificial intelligence (AI) research and innovations have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa, the rate of perinatal mortality is very high due to limited access to antenatal screening. In these countries, AI models could be implemented to help clinicians acquire fetal ultrasound planes for the diagnosis of fetal abnormalities. So far, deep learning models have been proposed to identify standard fetal planes, but there is no evidence of their ability to generalise in centres with low resources, i.e. with limited access to high-end ultrasound equipment and ultrasound data. This work investigates for the first time different strategies to reduce the domain-shift effect arising from a fetal plane classification model trained on one clinical centre with high-resource settings and transferred to a new centre with low-resource settings. To that end, a classifier trained with 1792 patients from Spain is first evaluated on a new centre in Denmark in optimal conditions with 1008 patients and is later optimised to reach the same performance in five African centres (Egypt, Algeria, Uganda, Ghana and Malawi) with 25 patients each. The results show that a transfer learning approach for domain adaptation can be a solution to integrate small-size African samples with existing large-scale databases in developed countries. In particular, the model can be re-aligned and optimised to boost the performance on African populations by increasing the recall to [Formula: see text] and at the same time maintaining a high precision across centres. This framework shows promise for building new AI models generalisable across clinical centres with limited data acquired in challenging and heterogeneous conditions and calls for further research to develop new solutions for the usability of AI in countries with fewer resources and, consequently, in higher need of clinical support. Nature Publishing Group UK 2023-02-15 /pmc/articles/PMC9932015/ /pubmed/36792642 http://dx.doi.org/10.1038/s41598-023-29490-3 Text en © The Author(s) 2023, corrected publication 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Sendra-Balcells, Carla
Campello, Víctor M.
Torrents-Barrena, Jordina
Ahmed, Yahya Ali
Elattar, Mustafa
Ohene-Botwe, Benard
Nyangulu, Pempho
Stones, William
Ammar, Mohammed
Benamer, Lamya Nawal
Kisembo, Harriet Nalubega
Sereke, Senai Goitom
Wanyonyi, Sikolia Z.
Temmerman, Marleen
Gratacós, Eduard
Bonet, Elisenda
Eixarch, Elisenda
Mikolaj, Kamil
Tolsgaard, Martin Grønnebæk
Lekadir, Karim
Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title_full Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title_fullStr Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title_full_unstemmed Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title_short Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries
title_sort generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five african countries
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932015/
https://www.ncbi.nlm.nih.gov/pubmed/36792642
http://dx.doi.org/10.1038/s41598-023-29490-3
work_keys_str_mv AT sendrabalcellscarla generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT campellovictorm generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT torrentsbarrenajordina generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT ahmedyahyaali generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT elattarmustafa generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT ohenebotwebenard generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT nyangulupempho generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT stoneswilliam generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT ammarmohammed generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT benamerlamyanawal generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT kisemboharrietnalubega generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT serekesenaigoitom generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT wanyonyisikoliaz generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT temmermanmarleen generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT gratacoseduard generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT bonetelisenda generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT eixarchelisenda generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT mikolajkamil generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT tolsgaardmartingrønnebæk generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries
AT lekadirkarim generalisabilityoffetalultrasounddeeplearningmodelstolowresourceimagingsettingsinfiveafricancountries