Cargando…

Deep learning-based optical field screening for robust optical diffraction tomography

In tomographic reconstruction, the image quality of the reconstructed images can be significantly degraded by defects in the measured two-dimensional (2D) raw image data. Despite the importance of screening defective 2D images for robust tomographic reconstruction, manual inspection and rule-based a...

Descripción completa

Detalles Bibliográficos
Autores principales: Ryu, DongHun, Jo, YoungJu, Yoo, Jihyeong, Chang, Taean, Ahn, Daewoong, Kim, Young Seo, Kim, Geon, Min, Hyun-Seok, Park, YongKeun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6811526/
https://www.ncbi.nlm.nih.gov/pubmed/31645595
http://dx.doi.org/10.1038/s41598-019-51363-x
_version_ 1783462480940367872
author Ryu, DongHun
Jo, YoungJu
Yoo, Jihyeong
Chang, Taean
Ahn, Daewoong
Kim, Young Seo
Kim, Geon
Min, Hyun-Seok
Park, YongKeun
author_facet Ryu, DongHun
Jo, YoungJu
Yoo, Jihyeong
Chang, Taean
Ahn, Daewoong
Kim, Young Seo
Kim, Geon
Min, Hyun-Seok
Park, YongKeun
author_sort Ryu, DongHun
collection PubMed
description In tomographic reconstruction, the image quality of the reconstructed images can be significantly degraded by defects in the measured two-dimensional (2D) raw image data. Despite the importance of screening defective 2D images for robust tomographic reconstruction, manual inspection and rule-based automation suffer from low-throughput and insufficient accuracy, respectively. Here, we present deep learning-enabled quality control for holographic data to produce robust and high-throughput optical diffraction tomography (ODT). The key idea is to distil the knowledge of an expert into a deep convolutional neural network. We built an extensive database of optical field images with clean/noisy annotations, and then trained a binary-classification network based upon the data. The trained network outperformed visual inspection by non-expert users and a widely used rule-based algorithm, with >90% test accuracy. Subsequently, we confirmed that the superior screening performance significantly improved the tomogram quality. To further confirm the trained model’s performance and generalisability, we evaluated it on unseen biological cell data obtained with a setup that was not used to generate the training dataset. Lastly, we interpreted the trained model using various visualisation techniques that provided the saliency map underlying each model inference. We envision the proposed network would a powerful lightweight module in the tomographic reconstruction pipeline.
format Online
Article
Text
id pubmed-6811526
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-68115262019-10-25 Deep learning-based optical field screening for robust optical diffraction tomography Ryu, DongHun Jo, YoungJu Yoo, Jihyeong Chang, Taean Ahn, Daewoong Kim, Young Seo Kim, Geon Min, Hyun-Seok Park, YongKeun Sci Rep Article In tomographic reconstruction, the image quality of the reconstructed images can be significantly degraded by defects in the measured two-dimensional (2D) raw image data. Despite the importance of screening defective 2D images for robust tomographic reconstruction, manual inspection and rule-based automation suffer from low-throughput and insufficient accuracy, respectively. Here, we present deep learning-enabled quality control for holographic data to produce robust and high-throughput optical diffraction tomography (ODT). The key idea is to distil the knowledge of an expert into a deep convolutional neural network. We built an extensive database of optical field images with clean/noisy annotations, and then trained a binary-classification network based upon the data. The trained network outperformed visual inspection by non-expert users and a widely used rule-based algorithm, with >90% test accuracy. Subsequently, we confirmed that the superior screening performance significantly improved the tomogram quality. To further confirm the trained model’s performance and generalisability, we evaluated it on unseen biological cell data obtained with a setup that was not used to generate the training dataset. Lastly, we interpreted the trained model using various visualisation techniques that provided the saliency map underlying each model inference. We envision the proposed network would a powerful lightweight module in the tomographic reconstruction pipeline. Nature Publishing Group UK 2019-10-23 /pmc/articles/PMC6811526/ /pubmed/31645595 http://dx.doi.org/10.1038/s41598-019-51363-x Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Ryu, DongHun
Jo, YoungJu
Yoo, Jihyeong
Chang, Taean
Ahn, Daewoong
Kim, Young Seo
Kim, Geon
Min, Hyun-Seok
Park, YongKeun
Deep learning-based optical field screening for robust optical diffraction tomography
title Deep learning-based optical field screening for robust optical diffraction tomography
title_full Deep learning-based optical field screening for robust optical diffraction tomography
title_fullStr Deep learning-based optical field screening for robust optical diffraction tomography
title_full_unstemmed Deep learning-based optical field screening for robust optical diffraction tomography
title_short Deep learning-based optical field screening for robust optical diffraction tomography
title_sort deep learning-based optical field screening for robust optical diffraction tomography
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6811526/
https://www.ncbi.nlm.nih.gov/pubmed/31645595
http://dx.doi.org/10.1038/s41598-019-51363-x
work_keys_str_mv AT ryudonghun deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT joyoungju deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT yoojihyeong deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT changtaean deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT ahndaewoong deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT kimyoungseo deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT kimgeon deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT minhyunseok deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography
AT parkyongkeun deeplearningbasedopticalfieldscreeningforrobustopticaldiffractiontomography