Cargando…

Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition

In many decision-making scenarios, ranging from recreational activities to healthcare and policing, the use of artificial intelligence coupled with the ability to learn from historical data is becoming ubiquitous. This widespread adoption of automated systems is accompanied by the increasing concern...

Descripción completa

Detalles Bibliográficos
Autores principales: Franco, Danilo, Oneto, Luca, Navarin, Nicolò, Anguita, Davide
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8393832/
https://www.ncbi.nlm.nih.gov/pubmed/34441187
http://dx.doi.org/10.3390/e23081047
_version_ 1783743814587908096
author Franco, Danilo
Oneto, Luca
Navarin, Nicolò
Anguita, Davide
author_facet Franco, Danilo
Oneto, Luca
Navarin, Nicolò
Anguita, Davide
author_sort Franco, Danilo
collection PubMed
description In many decision-making scenarios, ranging from recreational activities to healthcare and policing, the use of artificial intelligence coupled with the ability to learn from historical data is becoming ubiquitous. This widespread adoption of automated systems is accompanied by the increasing concerns regarding their ethical implications. Fundamental rights, such as the ones that require the preservation of privacy, do not discriminate based on sensible attributes (e.g., gender, ethnicity, political/sexual orientation), or require one to provide an explanation for a decision, are daily undermined by the use of increasingly complex and less understandable yet more accurate learning algorithms. For this purpose, in this work, we work toward the development of systems able to ensure trustworthiness by delivering privacy, fairness, and explainability by design. In particular, we show that it is possible to simultaneously learn from data while preserving the privacy of the individuals thanks to the use of Homomorphic Encryption, ensuring fairness by learning a fair representation from the data, and ensuring explainable decisions with local and global explanations without compromising the accuracy of the final models. We test our approach on a widespread but still controversial application, namely face recognition, using the recent FairFace dataset to prove the validity of our approach.
format Online
Article
Text
id pubmed-8393832
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83938322021-08-28 Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition Franco, Danilo Oneto, Luca Navarin, Nicolò Anguita, Davide Entropy (Basel) Article In many decision-making scenarios, ranging from recreational activities to healthcare and policing, the use of artificial intelligence coupled with the ability to learn from historical data is becoming ubiquitous. This widespread adoption of automated systems is accompanied by the increasing concerns regarding their ethical implications. Fundamental rights, such as the ones that require the preservation of privacy, do not discriminate based on sensible attributes (e.g., gender, ethnicity, political/sexual orientation), or require one to provide an explanation for a decision, are daily undermined by the use of increasingly complex and less understandable yet more accurate learning algorithms. For this purpose, in this work, we work toward the development of systems able to ensure trustworthiness by delivering privacy, fairness, and explainability by design. In particular, we show that it is possible to simultaneously learn from data while preserving the privacy of the individuals thanks to the use of Homomorphic Encryption, ensuring fairness by learning a fair representation from the data, and ensuring explainable decisions with local and global explanations without compromising the accuracy of the final models. We test our approach on a widespread but still controversial application, namely face recognition, using the recent FairFace dataset to prove the validity of our approach. MDPI 2021-08-14 /pmc/articles/PMC8393832/ /pubmed/34441187 http://dx.doi.org/10.3390/e23081047 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Franco, Danilo
Oneto, Luca
Navarin, Nicolò
Anguita, Davide
Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title_full Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title_fullStr Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title_full_unstemmed Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title_short Toward Learning Trustworthily from Data Combining Privacy, Fairness, and Explainability: An Application to Face Recognition
title_sort toward learning trustworthily from data combining privacy, fairness, and explainability: an application to face recognition
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8393832/
https://www.ncbi.nlm.nih.gov/pubmed/34441187
http://dx.doi.org/10.3390/e23081047
work_keys_str_mv AT francodanilo towardlearningtrustworthilyfromdatacombiningprivacyfairnessandexplainabilityanapplicationtofacerecognition
AT onetoluca towardlearningtrustworthilyfromdatacombiningprivacyfairnessandexplainabilityanapplicationtofacerecognition
AT navarinnicolo towardlearningtrustworthilyfromdatacombiningprivacyfairnessandexplainabilityanapplicationtofacerecognition
AT anguitadavide towardlearningtrustworthilyfromdatacombiningprivacyfairnessandexplainabilityanapplicationtofacerecognition