Cargando…

Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test

BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the uns...

Descripción completa

Detalles Bibliográficos
Autores principales: Park, Ho Young, Bae, Hyun-Jin, Hong, Gil-Sun, Kim, Minjee, Yun, JiHye, Park, Sungwon, Chung, Won Jung, Kim, NamKug
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8077702/
https://www.ncbi.nlm.nih.gov/pubmed/33609339
http://dx.doi.org/10.2196/23328
_version_ 1783684928334987264
author Park, Ho Young
Bae, Hyun-Jin
Hong, Gil-Sun
Kim, Minjee
Yun, JiHye
Park, Sungwon
Chung, Won Jung
Kim, NamKug
author_facet Park, Ho Young
Bae, Hyun-Jin
Hong, Gil-Sun
Kim, Minjee
Yun, JiHye
Park, Sungwon
Chung, Won Jung
Kim, NamKug
author_sort Park, Ho Young
collection PubMed
description BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the unsupervised synthesis of highly realistic body computed tomography (CT) images by using a progressive growing GAN (PGGAN) trained to learn the probability distribution of normal data. METHODS: We trained the PGGAN by using 11,755 body CT scans. Ten radiologists (4 radiologists with <5 years of experience [Group I], 4 radiologists with 5-10 years of experience [Group II], and 2 radiologists with >10 years of experience [Group III]) evaluated the results in a binary approach by using an independent validation set of 300 images (150 real and 150 synthetic) to judge the authenticity of each image. RESULTS: The mean accuracy of the 10 readers in the entire image set was higher than random guessing (1781/3000, 59.4% vs 1500/3000, 50.0%, respectively; P<.001). However, in terms of identifying synthetic images as fake, there was no significant difference in the specificity between the visual Turing test and random guessing (779/1500, 51.9% vs 750/1500, 50.0%, respectively; P=.29). The accuracy between the 3 reader groups with different experience levels was not significantly different (Group I, 696/1200, 58.0%; Group II, 726/1200, 60.5%; and Group III, 359/600, 59.8%; P=.36). Interreader agreements were poor (κ=0.11) for the entire image set. In subgroup analysis, the discrepancies between real and synthetic CT images occurred mainly in the thoracoabdominal junction and in the anatomical details. CONCLUSIONS: The GAN can synthesize highly realistic high-resolution body CT images that are indistinguishable from real images; however, it has limitations in generating body images of the thoracoabdominal junction and lacks accuracy in the anatomical details.
format Online
Article
Text
id pubmed-8077702
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-80777022021-05-06 Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test Park, Ho Young Bae, Hyun-Jin Hong, Gil-Sun Kim, Minjee Yun, JiHye Park, Sungwon Chung, Won Jung Kim, NamKug JMIR Med Inform Original Paper BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the unsupervised synthesis of highly realistic body computed tomography (CT) images by using a progressive growing GAN (PGGAN) trained to learn the probability distribution of normal data. METHODS: We trained the PGGAN by using 11,755 body CT scans. Ten radiologists (4 radiologists with <5 years of experience [Group I], 4 radiologists with 5-10 years of experience [Group II], and 2 radiologists with >10 years of experience [Group III]) evaluated the results in a binary approach by using an independent validation set of 300 images (150 real and 150 synthetic) to judge the authenticity of each image. RESULTS: The mean accuracy of the 10 readers in the entire image set was higher than random guessing (1781/3000, 59.4% vs 1500/3000, 50.0%, respectively; P<.001). However, in terms of identifying synthetic images as fake, there was no significant difference in the specificity between the visual Turing test and random guessing (779/1500, 51.9% vs 750/1500, 50.0%, respectively; P=.29). The accuracy between the 3 reader groups with different experience levels was not significantly different (Group I, 696/1200, 58.0%; Group II, 726/1200, 60.5%; and Group III, 359/600, 59.8%; P=.36). Interreader agreements were poor (κ=0.11) for the entire image set. In subgroup analysis, the discrepancies between real and synthetic CT images occurred mainly in the thoracoabdominal junction and in the anatomical details. CONCLUSIONS: The GAN can synthesize highly realistic high-resolution body CT images that are indistinguishable from real images; however, it has limitations in generating body images of the thoracoabdominal junction and lacks accuracy in the anatomical details. JMIR Publications 2021-03-17 /pmc/articles/PMC8077702/ /pubmed/33609339 http://dx.doi.org/10.2196/23328 Text en ©Ho Young Park, Hyun-Jin Bae, Gil-Sun Hong, Minjee Kim, JiHye Yun, Sungwon Park, Won Jung Chung, NamKug Kim. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 17.03.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Park, Ho Young
Bae, Hyun-Jin
Hong, Gil-Sun
Kim, Minjee
Yun, JiHye
Park, Sungwon
Chung, Won Jung
Kim, NamKug
Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title_full Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title_fullStr Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title_full_unstemmed Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title_short Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
title_sort realistic high-resolution body computed tomography image synthesis by using progressive growing generative adversarial network: visual turing test
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8077702/
https://www.ncbi.nlm.nih.gov/pubmed/33609339
http://dx.doi.org/10.2196/23328
work_keys_str_mv AT parkhoyoung realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT baehyunjin realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT honggilsun realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT kimminjee realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT yunjihye realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT parksungwon realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT chungwonjung realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest
AT kimnamkug realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest