Cargando…
Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging
Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluati...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9590390/ https://www.ncbi.nlm.nih.gov/pubmed/36313215 http://dx.doi.org/10.1007/s43681-022-00227-8 |
_version_ | 1784814501393072128 |
---|---|
author | Tripathi, Satvik Augustin, Alisha Dako, Farouk Kim, Edward |
author_facet | Tripathi, Satvik Augustin, Alisha Dako, Farouk Kim, Edward |
author_sort | Tripathi, Satvik |
collection | PubMed |
description | Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluating the future generation of medical diagnostics and medical robots, it remains an essential qualitative instrument. We propose a novel methodology to assess AI-based healthcare technology that provided verifiable diagnostic accuracy and statistical robustness. In order to run our test, we used a state-of-the-art AI model and compared it to radiologists for checking how generalized the model is and if any biases are prevalent. We achieved results that can evaluate the performance of our chosen model for this study in a clinical setting and we also applied a quantifiable method for evaluating our modified Turing test results using a meta-analytical evaluation framework. His test provides a translational standard for upcoming AI modalities. Our modified Turing test is a notably strong standard to measure the actual performance of the AI model on a variety of edge cases and normal cases and also helps in detecting if the algorithm is biased towards any one type of case. This method extends the flexibility to detect any prevalent biases and also classify the type of bias. |
format | Online Article Text |
id | pubmed-9590390 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-95903902022-10-24 Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging Tripathi, Satvik Augustin, Alisha Dako, Farouk Kim, Edward AI Ethics Original Research Due to the growing need to provide better global healthcare, computer-based and robotic healthcare equipment that depend on artificial intelligence has seen an increase in development. In order to evaluate artificial intelligence (AI) in computer technology, the Turing test was created. For evaluating the future generation of medical diagnostics and medical robots, it remains an essential qualitative instrument. We propose a novel methodology to assess AI-based healthcare technology that provided verifiable diagnostic accuracy and statistical robustness. In order to run our test, we used a state-of-the-art AI model and compared it to radiologists for checking how generalized the model is and if any biases are prevalent. We achieved results that can evaluate the performance of our chosen model for this study in a clinical setting and we also applied a quantifiable method for evaluating our modified Turing test results using a meta-analytical evaluation framework. His test provides a translational standard for upcoming AI modalities. Our modified Turing test is a notably strong standard to measure the actual performance of the AI model on a variety of edge cases and normal cases and also helps in detecting if the algorithm is biased towards any one type of case. This method extends the flexibility to detect any prevalent biases and also classify the type of bias. Springer International Publishing 2022-10-24 /pmc/articles/PMC9590390/ /pubmed/36313215 http://dx.doi.org/10.1007/s43681-022-00227-8 Text en © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2022, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Original Research Tripathi, Satvik Augustin, Alisha Dako, Farouk Kim, Edward Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title | Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title_full | Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title_fullStr | Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title_full_unstemmed | Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title_short | Turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
title_sort | turing test-inspired method for analysis of biases prevalent in artificial intelligence-based medical imaging |
topic | Original Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9590390/ https://www.ncbi.nlm.nih.gov/pubmed/36313215 http://dx.doi.org/10.1007/s43681-022-00227-8 |
work_keys_str_mv | AT tripathisatvik turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging AT augustinalisha turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging AT dakofarouk turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging AT kimedward turingtestinspiredmethodforanalysisofbiasesprevalentinartificialintelligencebasedmedicalimaging |