Cargando…
Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning
Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resol...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897388/ https://www.ncbi.nlm.nih.gov/pubmed/29651011 http://dx.doi.org/10.1038/s41598-018-24330-1 |
_version_ | 1783313948122021888 |
---|---|
author | Hagita, Katsumi Higuchi, Takeshi Jinnai, Hiroshi |
author_facet | Hagita, Katsumi Higuchi, Takeshi Jinnai, Hiroshi |
author_sort | Hagita, Katsumi |
collection | PubMed |
description | Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction. |
format | Online Article Text |
id | pubmed-5897388 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-58973882018-04-20 Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning Hagita, Katsumi Higuchi, Takeshi Jinnai, Hiroshi Sci Rep Article Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction. Nature Publishing Group UK 2018-04-12 /pmc/articles/PMC5897388/ /pubmed/29651011 http://dx.doi.org/10.1038/s41598-018-24330-1 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Hagita, Katsumi Higuchi, Takeshi Jinnai, Hiroshi Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title | Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title_full | Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title_fullStr | Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title_full_unstemmed | Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title_short | Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning |
title_sort | super-resolution for asymmetric resolution of fib-sem 3d imaging using ai with deep learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897388/ https://www.ncbi.nlm.nih.gov/pubmed/29651011 http://dx.doi.org/10.1038/s41598-018-24330-1 |
work_keys_str_mv | AT hagitakatsumi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning AT higuchitakeshi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning AT jinnaihiroshi superresolutionforasymmetricresolutionoffibsem3dimagingusingaiwithdeeplearning |