Cargando…

Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics

In recent years, generative adversarial networks (GANs) have gained tremendous popularity for potential applications in medical imaging, such as medical image synthesis, restoration, reconstruction, translation, as well as objective image quality assessment. Despite the impressive progress in genera...

Descripción completa

Detalles Bibliográficos
Autores principales: Kelkar, Varun A., Gotsis, Dimitrios S., Brooks, Frank J., KC, Prabhat, Myers, Kyle J., Zeng, Rongping, Anastasio, Mark A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10314718/
https://www.ncbi.nlm.nih.gov/pubmed/37022374
http://dx.doi.org/10.1109/TMI.2023.3241454
_version_ 1785067369924657152
author Kelkar, Varun A.
Gotsis, Dimitrios S.
Brooks, Frank J.
KC, Prabhat
Myers, Kyle J.
Zeng, Rongping
Anastasio, Mark A.
author_facet Kelkar, Varun A.
Gotsis, Dimitrios S.
Brooks, Frank J.
KC, Prabhat
Myers, Kyle J.
Zeng, Rongping
Anastasio, Mark A.
author_sort Kelkar, Varun A.
collection PubMed
description In recent years, generative adversarial networks (GANs) have gained tremendous popularity for potential applications in medical imaging, such as medical image synthesis, restoration, reconstruction, translation, as well as objective image quality assessment. Despite the impressive progress in generating high-resolution, perceptually realistic images, it is not clear if modern GANs reliably learn the statistics that are meaningful to a downstream medical imaging application. In this work, the ability of a state-of-the-art GAN to learn the statistics of canonical stochastic image models (SIMs) that are relevant to objective assessment of image quality is investigated. It is shown that although the employed GAN successfully learned several basic first- and second-order statistics of the specific medical SIMs under consideration and generated images with high perceptual quality, it failed to correctly learn several per-image statistics pertinent to the these SIMs, high-lighting the urgent need to assess medical image GANs in terms of objective measures of image quality.
format Online
Article
Text
id pubmed-10314718
institution National Center for Biotechnology Information
language English
publishDate 2023
record_format MEDLINE/PubMed
spelling pubmed-103147182023-07-01 Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics Kelkar, Varun A. Gotsis, Dimitrios S. Brooks, Frank J. KC, Prabhat Myers, Kyle J. Zeng, Rongping Anastasio, Mark A. IEEE Trans Med Imaging Article In recent years, generative adversarial networks (GANs) have gained tremendous popularity for potential applications in medical imaging, such as medical image synthesis, restoration, reconstruction, translation, as well as objective image quality assessment. Despite the impressive progress in generating high-resolution, perceptually realistic images, it is not clear if modern GANs reliably learn the statistics that are meaningful to a downstream medical imaging application. In this work, the ability of a state-of-the-art GAN to learn the statistics of canonical stochastic image models (SIMs) that are relevant to objective assessment of image quality is investigated. It is shown that although the employed GAN successfully learned several basic first- and second-order statistics of the specific medical SIMs under consideration and generated images with high perceptual quality, it failed to correctly learn several per-image statistics pertinent to the these SIMs, high-lighting the urgent need to assess medical image GANs in terms of objective measures of image quality. 2023-06 2023-06-01 /pmc/articles/PMC10314718/ /pubmed/37022374 http://dx.doi.org/10.1109/TMI.2023.3241454 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Kelkar, Varun A.
Gotsis, Dimitrios S.
Brooks, Frank J.
KC, Prabhat
Myers, Kyle J.
Zeng, Rongping
Anastasio, Mark A.
Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title_full Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title_fullStr Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title_full_unstemmed Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title_short Assessing the Ability of Generative Adversarial Networks to Learn Canonical Medical Image Statistics
title_sort assessing the ability of generative adversarial networks to learn canonical medical image statistics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10314718/
https://www.ncbi.nlm.nih.gov/pubmed/37022374
http://dx.doi.org/10.1109/TMI.2023.3241454
work_keys_str_mv AT kelkarvaruna assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT gotsisdimitrioss assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT brooksfrankj assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT kcprabhat assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT myerskylej assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT zengrongping assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics
AT anastasiomarka assessingtheabilityofgenerativeadversarialnetworkstolearncanonicalmedicalimagestatistics