Cargando…

A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs

Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, call...

Descripción completa

Detalles Bibliográficos
Autores principales: Tavakkoli, Alireza, Kamran, Sharif Amit, Hossain, Khondker Fariha, Zuckerbrod, Stewart Lee
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7725777/
https://www.ncbi.nlm.nih.gov/pubmed/33299065
http://dx.doi.org/10.1038/s41598-020-78696-2
_version_ 1783620771957964800
author Tavakkoli, Alireza
Kamran, Sharif Amit
Hossain, Khondker Fariha
Zuckerbrod, Stewart Lee
author_facet Tavakkoli, Alireza
Kamran, Sharif Amit
Hossain, Khondker Fariha
Zuckerbrod, Stewart Lee
author_sort Tavakkoli, Alireza
collection PubMed
description Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, called OCT angiography (OCTA), capable of visualizing retina vasculature. However, due to its cost and limited view, OCTA technology is not widely used. Retinal fundus photography is a safe imaging technique used for capturing the overall structure of the retina. In order to visualize retinal vasculature without the need for FA and in a cost-effective, non-invasive, and accurate manner, we propose a deep learning conditional generative adversarial network (GAN) capable of producing FA images from fundus photographs. The proposed GAN produces anatomically accurate angiograms, with similar fidelity to FA images, and significantly outperforms two other state-of-the-art generative algorithms ([Formula: see text] and [Formula: see text] ). Furthermore, evaluations by experts shows that our proposed model produces such high quality FA images that are indistinguishable from real angiograms. Our model as the first application of artificial intelligence and deep learning to medical image translation, by employing a theoretical framework capable of establishing a shared feature-space between two domains (i.e. funduscopy and fluorescein angiography) provides an unrivaled way for the translation of images from one domain to the other.
format Online
Article
Text
id pubmed-7725777
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-77257772020-12-14 A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs Tavakkoli, Alireza Kamran, Sharif Amit Hossain, Khondker Fariha Zuckerbrod, Stewart Lee Sci Rep Article Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, called OCT angiography (OCTA), capable of visualizing retina vasculature. However, due to its cost and limited view, OCTA technology is not widely used. Retinal fundus photography is a safe imaging technique used for capturing the overall structure of the retina. In order to visualize retinal vasculature without the need for FA and in a cost-effective, non-invasive, and accurate manner, we propose a deep learning conditional generative adversarial network (GAN) capable of producing FA images from fundus photographs. The proposed GAN produces anatomically accurate angiograms, with similar fidelity to FA images, and significantly outperforms two other state-of-the-art generative algorithms ([Formula: see text] and [Formula: see text] ). Furthermore, evaluations by experts shows that our proposed model produces such high quality FA images that are indistinguishable from real angiograms. Our model as the first application of artificial intelligence and deep learning to medical image translation, by employing a theoretical framework capable of establishing a shared feature-space between two domains (i.e. funduscopy and fluorescein angiography) provides an unrivaled way for the translation of images from one domain to the other. Nature Publishing Group UK 2020-12-09 /pmc/articles/PMC7725777/ /pubmed/33299065 http://dx.doi.org/10.1038/s41598-020-78696-2 Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Tavakkoli, Alireza
Kamran, Sharif Amit
Hossain, Khondker Fariha
Zuckerbrod, Stewart Lee
A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title_full A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title_fullStr A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title_full_unstemmed A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title_short A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
title_sort novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7725777/
https://www.ncbi.nlm.nih.gov/pubmed/33299065
http://dx.doi.org/10.1038/s41598-020-78696-2
work_keys_str_mv AT tavakkolialireza anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT kamransharifamit anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT hossainkhondkerfariha anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT zuckerbrodstewartlee anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT tavakkolialireza noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT kamransharifamit noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT hossainkhondkerfariha noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs
AT zuckerbrodstewartlee noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs