Cargando…

Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging

Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluati...

Descripción completa

Detalles Bibliográficos
Autores principales: Tripathi, Satvik, Augustin, Alisha, Dako, Farouk, Kim, Edward
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9590390/
https://www.ncbi.nlm.nih.gov/pubmed/36313215
http://dx.doi.org/10.1007/s43681-022-00227-8
_version_ 1784814501393072128
author Tripathi, Satvik
Augustin, Alisha
Dako, Farouk
Kim, Edward
author_facet Tripathi, Satvik
Augustin, Alisha
Dako, Farouk
Kim, Edward
author_sort Tripathi, Satvik
collection PubMed
description Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluating the future generation of medical diagnostics and medical robots, it remains an essential qualitative instrument. We propose a novel methodology to assess AI-based healthcare technology that provided verifiable diagnostic accuracy and statistical robustness. In order to run our test, we used a state-of-the-art AI model and compared it to radiologists for checking how generalized the model is and if any biases are prevalent. We achieved results that can evaluate the performance of our chosen model for this study in a clinical setting and we also applied a quantifiable method for evaluating our modified Turing test results using a meta-analytical evaluation framework. His test provides a translational standard for upcoming AI modalities. Our modified Turing test is a notably strong standard to measure the actual performance of the AI model on a variety of edge cases and normal cases and also helps in detecting if the algorithm is biased towards any one type of case. This method extends the flexibility to detect any prevalent biases and also classify the type of bias.
format Online
Article
Text
id pubmed-9590390
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-95903902022-10-24 Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging Tripathi, Satvik Augustin, Alisha Dako, Farouk Kim, Edward AI Ethics Original Research Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluating the future generation of medical diagnostics and medical robots, it remains an essential qualitative instrument. We propose a novel methodology to assess AI-based healthcare technology that provided verifiable diagnostic accuracy and statistical robustness. In order to run our test, we used a state-of-the-art AI model and compared it to radiologists for checking how generalized the model is and if any biases are prevalent. We achieved results that can evaluate the performance of our chosen model for this study in a clinical setting and we also applied a quantifiable method for evaluating our modified Turing test results using a meta-analytical evaluation framework. His test provides a translational standard for upcoming AI modalities. Our modified Turing test is a notably strong standard to measure the actual performance of the AI model on a variety of edge cases and normal cases and also helps in detecting if the algorithm is biased towards any one type of case. This method extends the flexibility to detect any prevalent biases and also classify the type of bias. Springer International Publishing 2022-10-24 /pmc/articles/PMC9590390/ /pubmed/36313215 http://dx.doi.org/10.1007/s43681-022-00227-8 Text en © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2022, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Original Research
Tripathi, Satvik
Augustin, Alisha
Dako, Farouk
Kim, Edward
Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title_full Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title_fullStr Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title_full_unstemmed Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title_short Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
title_sort turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9590390/
https://www.ncbi.nlm.nih.gov/pubmed/36313215
http://dx.doi.org/10.1007/s43681-022-00227-8
work_keys_str_mv AT tripathisatvik turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging
AT augustinalisha turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging
AT dakofarouk turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging
AT kimedward turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging