Cargando…

Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning

Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resol...

Descripción completa

Detalles Bibliográficos
Autores principales: Hagita, Katsumi, Higuchi, Takeshi, Jinnai, Hiroshi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897388/
https://www.ncbi.nlm.nih.gov/pubmed/29651011
http://dx.doi.org/10.1038/s41598-018-24330-1
_version_ 1783313948122021888
author Hagita, Katsumi
Higuchi, Takeshi
Jinnai, Hiroshi
author_facet Hagita, Katsumi
Higuchi, Takeshi
Jinnai, Hiroshi
author_sort Hagita, Katsumi
collection PubMed
description Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.
format Online
Article
Text
id pubmed-5897388
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-58973882018-04-20 Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning Hagita, Katsumi Higuchi, Takeshi Jinnai, Hiroshi Sci Rep Article Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction. Nature Publishing Group UK 2018-04-12 /pmc/articles/PMC5897388/ /pubmed/29651011 http://dx.doi.org/10.1038/s41598-018-24330-1 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Hagita, Katsumi
Higuchi, Takeshi
Jinnai, Hiroshi
Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title_full Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title_fullStr Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title_full_unstemmed Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title_short Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
title_sort super-resolution for asymmetric resolution of fib-sem 3d imaging using ai with deep learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897388/
https://www.ncbi.nlm.nih.gov/pubmed/29651011
http://dx.doi.org/10.1038/s41598-018-24330-1
work_keys_str_mv AT hagitakatsumi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning
AT higuchitakeshi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning
AT jinnaihiroshi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning