Cargando…

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

PURPOSE: To assess whether a generative adversarial network (GAN) could synthesize realistic optical coherence tomography (OCT) images that satisfactorily serve as the educational images for retinal specialists, and the training datasets for the classification of various retinal disorders using deep...

Descripción completa

Detalles Bibliográficos
Autores principales: Zheng, Ce, Xie, Xiaolin, Zhou, Kang, Chen, Bang, Chen, Jili, Ye, Haiyun, Li, Wen, Qiao, Tong, Gao, Shenghua, Yang, Jianlong, Liu, Jiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Association for Research in Vision and Ophthalmology 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7410116/
https://www.ncbi.nlm.nih.gov/pubmed/32832202
http://dx.doi.org/10.1167/tvst.9.2.29
_version_ 1783568176775168000
author Zheng, Ce
Xie, Xiaolin
Zhou, Kang
Chen, Bang
Chen, Jili
Ye, Haiyun
Li, Wen
Qiao, Tong
Gao, Shenghua
Yang, Jianlong
Liu, Jiang
author_facet Zheng, Ce
Xie, Xiaolin
Zhou, Kang
Chen, Bang
Chen, Jili
Ye, Haiyun
Li, Wen
Qiao, Tong
Gao, Shenghua
Yang, Jianlong
Liu, Jiang
author_sort Zheng, Ce
collection PubMed
description PURPOSE: To assess whether a generative adversarial network (GAN) could synthesize realistic optical coherence tomography (OCT) images that satisfactorily serve as the educational images for retinal specialists, and the training datasets for the classification of various retinal disorders using deep learning (DL). METHODS: The GANs architecture was adopted to synthesize high-resolution OCT images trained on a publicly available OCT dataset, including urgent referrals (37,206 OCT images from eyes with choroidal neovascularization, and 11,349 OCT images from eyes with diabetic macular edema) and nonurgent referrals (8617 OCT images from eyes with drusen, and 51,140 OCT images from normal eyes). Four hundred real and synthetic OCT images were evaluated by two retinal specialists (with over 10 years of clinical retinal experience) to assess image quality. We further trained two DL models on either real or synthetic datasets and compared the performance of urgent versus nonurgent referrals diagnosis tested on a local (1000 images from the public dataset) and clinical validation dataset (278 images from Shanghai Shibei Hospital). RESULTS: The image quality of real versus synthetic OCT images was similar as assessed by two retinal specialists. The accuracy of discrimination of real versus synthetic OCT images was 59.50% for retinal specialist 1 and 53.67% for retinal specialist 2. For the local dataset, the DL model trained on real (DL_Model_R) and synthetic OCT images (DL_Model_S) had an area under the curve (AUC) of 0.99, and 0.98, respectively. For the clinical dataset, the AUC was 0.94 for DL_Model_R and 0.90 for DL_Model_S. CONCLUSIONS: The GAN synthetic OCT images can be used by clinicians for educational purposes and for developing DL algorithms. TRANSLATIONAL RELEVANCE: The medical image synthesis based on GANs is promising in humans and machines to fulfill clinical tasks.
format Online
Article
Text
id pubmed-7410116
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher The Association for Research in Vision and Ophthalmology
record_format MEDLINE/PubMed
spelling pubmed-74101162020-08-21 Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders Zheng, Ce Xie, Xiaolin Zhou, Kang Chen, Bang Chen, Jili Ye, Haiyun Li, Wen Qiao, Tong Gao, Shenghua Yang, Jianlong Liu, Jiang Transl Vis Sci Technol Special Issue PURPOSE: To assess whether a generative adversarial network (GAN) could synthesize realistic optical coherence tomography (OCT) images that satisfactorily serve as the educational images for retinal specialists, and the training datasets for the classification of various retinal disorders using deep learning (DL). METHODS: The GANs architecture was adopted to synthesize high-resolution OCT images trained on a publicly available OCT dataset, including urgent referrals (37,206 OCT images from eyes with choroidal neovascularization, and 11,349 OCT images from eyes with diabetic macular edema) and nonurgent referrals (8617 OCT images from eyes with drusen, and 51,140 OCT images from normal eyes). Four hundred real and synthetic OCT images were evaluated by two retinal specialists (with over 10 years of clinical retinal experience) to assess image quality. We further trained two DL models on either real or synthetic datasets and compared the performance of urgent versus nonurgent referrals diagnosis tested on a local (1000 images from the public dataset) and clinical validation dataset (278 images from Shanghai Shibei Hospital). RESULTS: The image quality of real versus synthetic OCT images was similar as assessed by two retinal specialists. The accuracy of discrimination of real versus synthetic OCT images was 59.50% for retinal specialist 1 and 53.67% for retinal specialist 2. For the local dataset, the DL model trained on real (DL_Model_R) and synthetic OCT images (DL_Model_S) had an area under the curve (AUC) of 0.99, and 0.98, respectively. For the clinical dataset, the AUC was 0.94 for DL_Model_R and 0.90 for DL_Model_S. CONCLUSIONS: The GAN synthetic OCT images can be used by clinicians for educational purposes and for developing DL algorithms. TRANSLATIONAL RELEVANCE: The medical image synthesis based on GANs is promising in humans and machines to fulfill clinical tasks. The Association for Research in Vision and Ophthalmology 2020-05-27 /pmc/articles/PMC7410116/ /pubmed/32832202 http://dx.doi.org/10.1167/tvst.9.2.29 Text en Copyright 2020 The Authors http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License.
spellingShingle Special Issue
Zheng, Ce
Xie, Xiaolin
Zhou, Kang
Chen, Bang
Chen, Jili
Ye, Haiyun
Li, Wen
Qiao, Tong
Gao, Shenghua
Yang, Jianlong
Liu, Jiang
Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title_full Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title_fullStr Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title_full_unstemmed Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title_short Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
title_sort assessment of generative adversarial networks model for synthetic optical coherence tomography images of retinal disorders
topic Special Issue
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7410116/
https://www.ncbi.nlm.nih.gov/pubmed/32832202
http://dx.doi.org/10.1167/tvst.9.2.29
work_keys_str_mv AT zhengce assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT xiexiaolin assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT zhoukang assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT chenbang assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT chenjili assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT yehaiyun assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT liwen assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT qiaotong assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT gaoshenghua assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT yangjianlong assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders
AT liujiang assessmentofgenerativeadversarialnetworksmodelforsyntheticopticalcoherencetomographyimagesofretinaldisorders