Cargando…

Generalisability through local validation: overcoming barriers due to data disparity in healthcare

Cho et al. report deep learning model accuracy for tilted myopic disc detection in a South Korean population. Here we explore the importance of generalisability of machine learning (ML) in healthcare, and we emphasise that recurrent underrepresentation of data-poor regions may inadvertently perpetua...

Descripción completa

Detalles Bibliográficos
Autores principales: Mitchell, William Greig, Dee, Edward Christopher, Celi, Leo Anthony
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8138973/
https://www.ncbi.nlm.nih.gov/pubmed/34020592
http://dx.doi.org/10.1186/s12886-021-01992-6
_version_ 1783695911836188672
author Mitchell, William Greig
Dee, Edward Christopher
Celi, Leo Anthony
author_facet Mitchell, William Greig
Dee, Edward Christopher
Celi, Leo Anthony
author_sort Mitchell, William Greig
collection PubMed
description Cho et al. report deep learning model accuracy for tilted myopic disc detection in a South Korean population. Here we explore the importance of generalisability of machine learning (ML) in healthcare, and we emphasise that recurrent underrepresentation of data-poor regions may inadvertently perpetuate global health inequity. Creating meaningful ML systems is contingent on understanding how, when, and why different ML models work in different settings. While we echo the need for the diversification of ML datasets, such a worthy effort would take time and does not obviate uses of presently available datasets if conclusions are validated and re-calibrated for different groups prior to implementation. The importance of external ML model validation on diverse populations should be highlighted where possible – especially for models built with single-centre data.
format Online
Article
Text
id pubmed-8138973
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-81389732021-05-21 Generalisability through local validation: overcoming barriers due to data disparity in healthcare Mitchell, William Greig Dee, Edward Christopher Celi, Leo Anthony BMC Ophthalmol Correspondence Cho et al. report deep learning model accuracy for tilted myopic disc detection in a South Korean population. Here we explore the importance of generalisability of machine learning (ML) in healthcare, and we emphasise that recurrent underrepresentation of data-poor regions may inadvertently perpetuate global health inequity. Creating meaningful ML systems is contingent on understanding how, when, and why different ML models work in different settings. While we echo the need for the diversification of ML datasets, such a worthy effort would take time and does not obviate uses of presently available datasets if conclusions are validated and re-calibrated for different groups prior to implementation. The importance of external ML model validation on diverse populations should be highlighted where possible – especially for models built with single-centre data. BioMed Central 2021-05-21 /pmc/articles/PMC8138973/ /pubmed/34020592 http://dx.doi.org/10.1186/s12886-021-01992-6 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Correspondence
Mitchell, William Greig
Dee, Edward Christopher
Celi, Leo Anthony
Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title_full Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title_fullStr Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title_full_unstemmed Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title_short Generalisability through local validation: overcoming barriers due to data disparity in healthcare
title_sort generalisability through local validation: overcoming barriers due to data disparity in healthcare
topic Correspondence
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8138973/
https://www.ncbi.nlm.nih.gov/pubmed/34020592
http://dx.doi.org/10.1186/s12886-021-01992-6
work_keys_str_mv AT mitchellwilliamgreig generalisabilitythroughlocalvalidationovercomingbarriersduetodatadisparityinhealthcare
AT deeedwardchristopher generalisabilitythroughlocalvalidationovercomingbarriersduetodatadisparityinhealthcare
AT celileoanthony generalisabilitythroughlocalvalidationovercomingbarriersduetodatadisparityinhealthcare