Cargando…
A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs
Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, call...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7725777/ https://www.ncbi.nlm.nih.gov/pubmed/33299065 http://dx.doi.org/10.1038/s41598-020-78696-2 |
_version_ | 1783620771957964800 |
---|---|
author | Tavakkoli, Alireza Kamran, Sharif Amit Hossain, Khondker Fariha Zuckerbrod, Stewart Lee |
author_facet | Tavakkoli, Alireza Kamran, Sharif Amit Hossain, Khondker Fariha Zuckerbrod, Stewart Lee |
author_sort | Tavakkoli, Alireza |
collection | PubMed |
description | Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, called OCT angiography (OCTA), capable of visualizing retina vasculature. However, due to its cost and limited view, OCTA technology is not widely used. Retinal fundus photography is a safe imaging technique used for capturing the overall structure of the retina. In order to visualize retinal vasculature without the need for FA and in a cost-effective, non-invasive, and accurate manner, we propose a deep learning conditional generative adversarial network (GAN) capable of producing FA images from fundus photographs. The proposed GAN produces anatomically accurate angiograms, with similar fidelity to FA images, and significantly outperforms two other state-of-the-art generative algorithms ([Formula: see text] and [Formula: see text] ). Furthermore, evaluations by experts shows that our proposed model produces such high quality FA images that are indistinguishable from real angiograms. Our model as the first application of artificial intelligence and deep learning to medical image translation, by employing a theoretical framework capable of establishing a shared feature-space between two domains (i.e. funduscopy and fluorescein angiography) provides an unrivaled way for the translation of images from one domain to the other. |
format | Online Article Text |
id | pubmed-7725777 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-77257772020-12-14 A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs Tavakkoli, Alireza Kamran, Sharif Amit Hossain, Khondker Fariha Zuckerbrod, Stewart Lee Sci Rep Article Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, called OCT angiography (OCTA), capable of visualizing retina vasculature. However, due to its cost and limited view, OCTA technology is not widely used. Retinal fundus photography is a safe imaging technique used for capturing the overall structure of the retina. In order to visualize retinal vasculature without the need for FA and in a cost-effective, non-invasive, and accurate manner, we propose a deep learning conditional generative adversarial network (GAN) capable of producing FA images from fundus photographs. The proposed GAN produces anatomically accurate angiograms, with similar fidelity to FA images, and significantly outperforms two other state-of-the-art generative algorithms ([Formula: see text] and [Formula: see text] ). Furthermore, evaluations by experts shows that our proposed model produces such high quality FA images that are indistinguishable from real angiograms. Our model as the first application of artificial intelligence and deep learning to medical image translation, by employing a theoretical framework capable of establishing a shared feature-space between two domains (i.e. funduscopy and fluorescein angiography) provides an unrivaled way for the translation of images from one domain to the other. Nature Publishing Group UK 2020-12-09 /pmc/articles/PMC7725777/ /pubmed/33299065 http://dx.doi.org/10.1038/s41598-020-78696-2 Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Tavakkoli, Alireza Kamran, Sharif Amit Hossain, Khondker Fariha Zuckerbrod, Stewart Lee A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title | A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title_full | A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title_fullStr | A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title_full_unstemmed | A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title_short | A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
title_sort | novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7725777/ https://www.ncbi.nlm.nih.gov/pubmed/33299065 http://dx.doi.org/10.1038/s41598-020-78696-2 |
work_keys_str_mv | AT tavakkolialireza anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT kamransharifamit anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT hossainkhondkerfariha anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT zuckerbrodstewartlee anoveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT tavakkolialireza noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT kamransharifamit noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT hossainkhondkerfariha noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs AT zuckerbrodstewartlee noveldeeplearningconditionalgenerativeadversarialnetworkforproducingangiographyimagesfromretinalfundusphotographs |