Cargando…

An adversarial training framework for mitigating algorithmic biases in clinical machine learning

Machine learning is becoming increasingly prominent in healthcare. Although its benefits are clear, growing attention is being given to how these tools may exacerbate existing biases and disparities. In this study, we introduce an adversarial training framework that is capable of mitigating biases t...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Jenny, Soltan, Andrew A. S., Eyre, David W., Yang, Yang, Clifton, David A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10050816/
https://www.ncbi.nlm.nih.gov/pubmed/36991077
http://dx.doi.org/10.1038/s41746-023-00805-y
_version_ 1785014718456397824
author Yang, Jenny
Soltan, Andrew A. S.
Eyre, David W.
Yang, Yang
Clifton, David A.
author_facet Yang, Jenny
Soltan, Andrew A. S.
Eyre, David W.
Yang, Yang
Clifton, David A.
author_sort Yang, Jenny
collection PubMed
description Machine learning is becoming increasingly prominent in healthcare. Although its benefits are clear, growing attention is being given to how these tools may exacerbate existing biases and disparities. In this study, we introduce an adversarial training framework that is capable of mitigating biases that may have been acquired through data collection. We demonstrate this proposed framework on the real-world task of rapidly predicting COVID-19, and focus on mitigating site-specific (hospital) and demographic (ethnicity) biases. Using the statistical definition of equalized odds, we show that adversarial training improves outcome fairness, while still achieving clinically-effective screening performances (negative predictive values >0.98). We compare our method to previous benchmarks, and perform prospective and external validation across four independent hospital cohorts. Our method can be generalized to any outcomes, models, and definitions of fairness.
format Online
Article
Text
id pubmed-10050816
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-100508162023-03-29 An adversarial training framework for mitigating algorithmic biases in clinical machine learning Yang, Jenny Soltan, Andrew A. S. Eyre, David W. Yang, Yang Clifton, David A. NPJ Digit Med Article Machine learning is becoming increasingly prominent in healthcare. Although its benefits are clear, growing attention is being given to how these tools may exacerbate existing biases and disparities. In this study, we introduce an adversarial training framework that is capable of mitigating biases that may have been acquired through data collection. We demonstrate this proposed framework on the real-world task of rapidly predicting COVID-19, and focus on mitigating site-specific (hospital) and demographic (ethnicity) biases. Using the statistical definition of equalized odds, we show that adversarial training improves outcome fairness, while still achieving clinically-effective screening performances (negative predictive values >0.98). We compare our method to previous benchmarks, and perform prospective and external validation across four independent hospital cohorts. Our method can be generalized to any outcomes, models, and definitions of fairness. Nature Publishing Group UK 2023-03-29 /pmc/articles/PMC10050816/ /pubmed/36991077 http://dx.doi.org/10.1038/s41746-023-00805-y Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Yang, Jenny
Soltan, Andrew A. S.
Eyre, David W.
Yang, Yang
Clifton, David A.
An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title_full An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title_fullStr An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title_full_unstemmed An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title_short An adversarial training framework for mitigating algorithmic biases in clinical machine learning
title_sort adversarial training framework for mitigating algorithmic biases in clinical machine learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10050816/
https://www.ncbi.nlm.nih.gov/pubmed/36991077
http://dx.doi.org/10.1038/s41746-023-00805-y
work_keys_str_mv AT yangjenny anadversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT soltanandrewas anadversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT eyredavidw anadversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT yangyang anadversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT cliftondavida anadversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT yangjenny adversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT soltanandrewas adversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT eyredavidw adversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT yangyang adversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning
AT cliftondavida adversarialtrainingframeworkformitigatingalgorithmicbiasesinclinicalmachinelearning