Cargando…
Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test
BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the uns...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8077702/ https://www.ncbi.nlm.nih.gov/pubmed/33609339 http://dx.doi.org/10.2196/23328 |
_version_ | 1783684928334987264 |
---|---|
author | Park, Ho Young Bae, Hyun-Jin Hong, Gil-Sun Kim, Minjee Yun, JiHye Park, Sungwon Chung, Won Jung Kim, NamKug |
author_facet | Park, Ho Young Bae, Hyun-Jin Hong, Gil-Sun Kim, Minjee Yun, JiHye Park, Sungwon Chung, Won Jung Kim, NamKug |
author_sort | Park, Ho Young |
collection | PubMed |
description | BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the unsupervised synthesis of highly realistic body computed tomography (CT) images by using a progressive growing GAN (PGGAN) trained to learn the probability distribution of normal data. METHODS: We trained the PGGAN by using 11,755 body CT scans. Ten radiologists (4 radiologists with <5 years of experience [Group I], 4 radiologists with 5-10 years of experience [Group II], and 2 radiologists with >10 years of experience [Group III]) evaluated the results in a binary approach by using an independent validation set of 300 images (150 real and 150 synthetic) to judge the authenticity of each image. RESULTS: The mean accuracy of the 10 readers in the entire image set was higher than random guessing (1781/3000, 59.4% vs 1500/3000, 50.0%, respectively; P<.001). However, in terms of identifying synthetic images as fake, there was no significant difference in the specificity between the visual Turing test and random guessing (779/1500, 51.9% vs 750/1500, 50.0%, respectively; P=.29). The accuracy between the 3 reader groups with different experience levels was not significantly different (Group I, 696/1200, 58.0%; Group II, 726/1200, 60.5%; and Group III, 359/600, 59.8%; P=.36). Interreader agreements were poor (κ=0.11) for the entire image set. In subgroup analysis, the discrepancies between real and synthetic CT images occurred mainly in the thoracoabdominal junction and in the anatomical details. CONCLUSIONS: The GAN can synthesize highly realistic high-resolution body CT images that are indistinguishable from real images; however, it has limitations in generating body images of the thoracoabdominal junction and lacks accuracy in the anatomical details. |
format | Online Article Text |
id | pubmed-8077702 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-80777022021-05-06 Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test Park, Ho Young Bae, Hyun-Jin Hong, Gil-Sun Kim, Minjee Yun, JiHye Park, Sungwon Chung, Won Jung Kim, NamKug JMIR Med Inform Original Paper BACKGROUND: Generative adversarial network (GAN)–based synthetic images can be viable solutions to current supervised deep learning challenges. However, generating highly realistic images is a prerequisite for these approaches. OBJECTIVE: The aim of this study was to investigate and validate the unsupervised synthesis of highly realistic body computed tomography (CT) images by using a progressive growing GAN (PGGAN) trained to learn the probability distribution of normal data. METHODS: We trained the PGGAN by using 11,755 body CT scans. Ten radiologists (4 radiologists with <5 years of experience [Group I], 4 radiologists with 5-10 years of experience [Group II], and 2 radiologists with >10 years of experience [Group III]) evaluated the results in a binary approach by using an independent validation set of 300 images (150 real and 150 synthetic) to judge the authenticity of each image. RESULTS: The mean accuracy of the 10 readers in the entire image set was higher than random guessing (1781/3000, 59.4% vs 1500/3000, 50.0%, respectively; P<.001). However, in terms of identifying synthetic images as fake, there was no significant difference in the specificity between the visual Turing test and random guessing (779/1500, 51.9% vs 750/1500, 50.0%, respectively; P=.29). The accuracy between the 3 reader groups with different experience levels was not significantly different (Group I, 696/1200, 58.0%; Group II, 726/1200, 60.5%; and Group III, 359/600, 59.8%; P=.36). Interreader agreements were poor (κ=0.11) for the entire image set. In subgroup analysis, the discrepancies between real and synthetic CT images occurred mainly in the thoracoabdominal junction and in the anatomical details. CONCLUSIONS: The GAN can synthesize highly realistic high-resolution body CT images that are indistinguishable from real images; however, it has limitations in generating body images of the thoracoabdominal junction and lacks accuracy in the anatomical details. JMIR Publications 2021-03-17 /pmc/articles/PMC8077702/ /pubmed/33609339 http://dx.doi.org/10.2196/23328 Text en ©Ho Young Park, Hyun-Jin Bae, Gil-Sun Hong, Minjee Kim, JiHye Yun, Sungwon Park, Won Jung Chung, NamKug Kim. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 17.03.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Park, Ho Young Bae, Hyun-Jin Hong, Gil-Sun Kim, Minjee Yun, JiHye Park, Sungwon Chung, Won Jung Kim, NamKug Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title | Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title_full | Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title_fullStr | Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title_full_unstemmed | Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title_short | Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test |
title_sort | realistic high-resolution body computed tomography image synthesis by using progressive growing generative adversarial network: visual turing test |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8077702/ https://www.ncbi.nlm.nih.gov/pubmed/33609339 http://dx.doi.org/10.2196/23328 |
work_keys_str_mv | AT parkhoyoung realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT baehyunjin realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT honggilsun realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT kimminjee realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT yunjihye realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT parksungwon realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT chungwonjung realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest AT kimnamkug realistichighresolutionbodycomputedtomographyimagesynthesisbyusingprogressivegrowinggenerativeadversarialnetworkvisualturingtest |