Cargando…

Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images

As the quality of image generation by deep learning increases, it is becoming difficult to discern its authenticity from the image alone. Currently, generative models represented by generative adversarial networks (GAN) are increasingly utilized in the research field of cardiology, and their potenti...

Descripción completa

Detalles Bibliográficos
Autores principales: Higaki, Akinori, Kawada, Yoshitaka, Hiasa, Go, Yamada, Tadakatsu, Okayama, Hideki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cureus 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9683859/
https://www.ncbi.nlm.nih.gov/pubmed/36439582
http://dx.doi.org/10.7759/cureus.30646
_version_ 1784835146080321536
author Higaki, Akinori
Kawada, Yoshitaka
Hiasa, Go
Yamada, Tadakatsu
Okayama, Hideki
author_facet Higaki, Akinori
Kawada, Yoshitaka
Hiasa, Go
Yamada, Tadakatsu
Okayama, Hideki
author_sort Higaki, Akinori
collection PubMed
description As the quality of image generation by deep learning increases, it is becoming difficult to discern its authenticity from the image alone. Currently, generative models represented by generative adversarial networks (GAN) are increasingly utilized in the research field of cardiology, and their potential risks are also being pointed out. In this context, we assessed whether expert cardiologists can detect synthesized myocardial perfusion images (MPI) generated by GAN as fake. A total of 1448 polar maps collected from consecutive patients who underwent MPI for known or suspected coronary artery disease from January 2020 to December 2021 were used for the analysis. A deep convolutional GAN was trained on the polar maps to synthesize realistic MPI. The realism of the generated images in terms of human perception was evaluated by the visual Turing test (VTT) on our original website. The average correct answer rate of the VTT was only 61.1% with a standard deviation of 21.5, but this improved to 80.0±15.8 (%) in the second trial when given the clue information. In the era of machine intelligence and virtual reality, digital literacy is becoming more necessary for healthcare professionals to identify deepfakes.
format Online
Article
Text
id pubmed-9683859
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Cureus
record_format MEDLINE/PubMed
spelling pubmed-96838592022-11-25 Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images Higaki, Akinori Kawada, Yoshitaka Hiasa, Go Yamada, Tadakatsu Okayama, Hideki Cureus Cardiology As the quality of image generation by deep learning increases, it is becoming difficult to discern its authenticity from the image alone. Currently, generative models represented by generative adversarial networks (GAN) are increasingly utilized in the research field of cardiology, and their potential risks are also being pointed out. In this context, we assessed whether expert cardiologists can detect synthesized myocardial perfusion images (MPI) generated by GAN as fake. A total of 1448 polar maps collected from consecutive patients who underwent MPI for known or suspected coronary artery disease from January 2020 to December 2021 were used for the analysis. A deep convolutional GAN was trained on the polar maps to synthesize realistic MPI. The realism of the generated images in terms of human perception was evaluated by the visual Turing test (VTT) on our original website. The average correct answer rate of the VTT was only 61.1% with a standard deviation of 21.5, but this improved to 80.0±15.8 (%) in the second trial when given the clue information. In the era of machine intelligence and virtual reality, digital literacy is becoming more necessary for healthcare professionals to identify deepfakes. Cureus 2022-10-24 /pmc/articles/PMC9683859/ /pubmed/36439582 http://dx.doi.org/10.7759/cureus.30646 Text en Copyright © 2022, Higaki et al. https://creativecommons.org/licenses/by/3.0/This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Cardiology
Higaki, Akinori
Kawada, Yoshitaka
Hiasa, Go
Yamada, Tadakatsu
Okayama, Hideki
Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title_full Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title_fullStr Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title_full_unstemmed Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title_short Using a Visual Turing Test to Evaluate the Realism of Generative Adversarial Network (GAN)-Based Synthesized Myocardial Perfusion Images
title_sort using a visual turing test to evaluate the realism of generative adversarial network (gan)-based synthesized myocardial perfusion images
topic Cardiology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9683859/
https://www.ncbi.nlm.nih.gov/pubmed/36439582
http://dx.doi.org/10.7759/cureus.30646
work_keys_str_mv AT higakiakinori usingavisualturingtesttoevaluatetherealismofgenerativeadversarialnetworkganbasedsynthesizedmyocardialperfusionimages
AT kawadayoshitaka usingavisualturingtesttoevaluatetherealismofgenerativeadversarialnetworkganbasedsynthesizedmyocardialperfusionimages
AT hiasago usingavisualturingtesttoevaluatetherealismofgenerativeadversarialnetworkganbasedsynthesizedmyocardialperfusionimages
AT yamadatadakatsu usingavisualturingtesttoevaluatetherealismofgenerativeadversarialnetworkganbasedsynthesizedmyocardialperfusionimages
AT okayamahideki usingavisualturingtesttoevaluatetherealismofgenerativeadversarialnetworkganbasedsynthesizedmyocardialperfusionimages