Cargando…
Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health
In Low- and Middle- Income Countries (LMICs), machine learning (ML) and artificial intelligence (AI) offer attractive solutions to address the shortage of health care resources and improve the capacity of the local health care infrastructure. However, AI and ML should also be used cautiously, due to...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8107824/ https://www.ncbi.nlm.nih.gov/pubmed/33981989 http://dx.doi.org/10.3389/frai.2020.561802 |
_version_ | 1783690020242063360 |
---|---|
author | Fletcher, Richard Ribón Nakeshimana, Audace Olubeko, Olusubomi |
author_facet | Fletcher, Richard Ribón Nakeshimana, Audace Olubeko, Olusubomi |
author_sort | Fletcher, Richard Ribón |
collection | PubMed |
description | In Low- and Middle- Income Countries (LMICs), machine learning (ML) and artificial intelligence (AI) offer attractive solutions to address the shortage of health care resources and improve the capacity of the local health care infrastructure. However, AI and ML should also be used cautiously, due to potential issues of fairness and algorithmic bias that may arise if not applied properly. Furthermore, populations in LMICs can be particularly vulnerable to bias and fairness in AI algorithms, due to a lack of technical capacity, existing social bias against minority groups, and a lack of legal protections. In order to address the need for better guidance within the context of global health, we describe three basic criteria (Appropriateness, Fairness, and Bias) that can be used to help evaluate the use of machine learning and AI systems: 1) APPROPRIATENESS is the process of deciding how the algorithm should be used in the local context, and properly matching the machine learning model to the target population; 2) BIAS is a systematic tendency in a model to favor one demographic group vs another, which can be mitigated but can lead to unfairness; and 3) FAIRNESS involves examining the impact on various demographic groups and choosing one of several mathematical definitions of group fairness that will adequately satisfy the desired set of legal, cultural, and ethical requirements. Finally, we illustrate how these principles can be applied using a case study of machine learning applied to the diagnosis and screening of pulmonary disease in Pune, India. We hope that these methods and principles can help guide researchers and organizations working in global health who are considering the use of machine learning and artificial intelligence. |
format | Online Article Text |
id | pubmed-8107824 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-81078242021-05-11 Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health Fletcher, Richard Ribón Nakeshimana, Audace Olubeko, Olusubomi Front Artif Intell Artificial Intelligence In Low- and Middle- Income Countries (LMICs), machine learning (ML) and artificial intelligence (AI) offer attractive solutions to address the shortage of health care resources and improve the capacity of the local health care infrastructure. However, AI and ML should also be used cautiously, due to potential issues of fairness and algorithmic bias that may arise if not applied properly. Furthermore, populations in LMICs can be particularly vulnerable to bias and fairness in AI algorithms, due to a lack of technical capacity, existing social bias against minority groups, and a lack of legal protections. In order to address the need for better guidance within the context of global health, we describe three basic criteria (Appropriateness, Fairness, and Bias) that can be used to help evaluate the use of machine learning and AI systems: 1) APPROPRIATENESS is the process of deciding how the algorithm should be used in the local context, and properly matching the machine learning model to the target population; 2) BIAS is a systematic tendency in a model to favor one demographic group vs another, which can be mitigated but can lead to unfairness; and 3) FAIRNESS involves examining the impact on various demographic groups and choosing one of several mathematical definitions of group fairness that will adequately satisfy the desired set of legal, cultural, and ethical requirements. Finally, we illustrate how these principles can be applied using a case study of machine learning applied to the diagnosis and screening of pulmonary disease in Pune, India. We hope that these methods and principles can help guide researchers and organizations working in global health who are considering the use of machine learning and artificial intelligence. Frontiers Media S.A. 2021-04-15 /pmc/articles/PMC8107824/ /pubmed/33981989 http://dx.doi.org/10.3389/frai.2020.561802 Text en Copyright © 2021 Fletcher, Nakeshimana and Olubeko. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Artificial Intelligence Fletcher, Richard Ribón Nakeshimana, Audace Olubeko, Olusubomi Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title | Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title_full | Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title_fullStr | Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title_full_unstemmed | Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title_short | Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health |
title_sort | addressing fairness, bias, and appropriate use of artificial intelligence and machine learning in global health |
topic | Artificial Intelligence |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8107824/ https://www.ncbi.nlm.nih.gov/pubmed/33981989 http://dx.doi.org/10.3389/frai.2020.561802 |
work_keys_str_mv | AT fletcherrichardribon addressingfairnessbiasandappropriateuseofartificialintelligenceandmachinelearninginglobalhealth AT nakeshimanaaudace addressingfairnessbiasandappropriateuseofartificialintelligenceandmachinelearninginglobalhealth AT olubekoolusubomi addressingfairnessbiasandappropriateuseofartificialintelligenceandmachinelearninginglobalhealth |