Cargando…

A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images

To accurately identify atoms on noisy transmission electron microscope images, a deep learning (DL) approach is employed to estimate the map of probabilities at each pixel for being an atom with element discernment. Thanks to a delicately-designed loss function and the ability to extract features, t...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Yuan, Liu, Shangpeng, Tong, Peiran, Huang, Ying, Tian, He, Lin, Fang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9929221/
https://www.ncbi.nlm.nih.gov/pubmed/36788257
http://dx.doi.org/10.1038/s41598-023-29606-9
_version_ 1784888802645377024
author Chen, Yuan
Liu, Shangpeng
Tong, Peiran
Huang, Ying
Tian, He
Lin, Fang
author_facet Chen, Yuan
Liu, Shangpeng
Tong, Peiran
Huang, Ying
Tian, He
Lin, Fang
author_sort Chen, Yuan
collection PubMed
description To accurately identify atoms on noisy transmission electron microscope images, a deep learning (DL) approach is employed to estimate the map of probabilities at each pixel for being an atom with element discernment. Thanks to a delicately-designed loss function and the ability to extract features, the proposed DL networks can be trained by a small dataset created from approximately 30 experimental images, each with a size of 256 × 256 pixels(2). The accuracy and robustness of the network were verified by resolving the structural defects of graphene and polar structures in PbTiO(3)/SrTiO(3) multilayers from both the general TEM images and their imitated images on which intensities of some pixels lost randomly. Such a network has the potential to identify atoms from very few images of beam-sensitive material and explosive images recorded in a dynamical atomic process. The idea of using a small-dataset-trained DL framework to resolve a specific problem may prove instructive for practical DL applications in various fields.
format Online
Article
Text
id pubmed-9929221
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-99292212023-02-16 A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images Chen, Yuan Liu, Shangpeng Tong, Peiran Huang, Ying Tian, He Lin, Fang Sci Rep Article To accurately identify atoms on noisy transmission electron microscope images, a deep learning (DL) approach is employed to estimate the map of probabilities at each pixel for being an atom with element discernment. Thanks to a delicately-designed loss function and the ability to extract features, the proposed DL networks can be trained by a small dataset created from approximately 30 experimental images, each with a size of 256 × 256 pixels(2). The accuracy and robustness of the network were verified by resolving the structural defects of graphene and polar structures in PbTiO(3)/SrTiO(3) multilayers from both the general TEM images and their imitated images on which intensities of some pixels lost randomly. Such a network has the potential to identify atoms from very few images of beam-sensitive material and explosive images recorded in a dynamical atomic process. The idea of using a small-dataset-trained DL framework to resolve a specific problem may prove instructive for practical DL applications in various fields. Nature Publishing Group UK 2023-02-14 /pmc/articles/PMC9929221/ /pubmed/36788257 http://dx.doi.org/10.1038/s41598-023-29606-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Chen, Yuan
Liu, Shangpeng
Tong, Peiran
Huang, Ying
Tian, He
Lin, Fang
A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title_full A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title_fullStr A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title_full_unstemmed A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title_short A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
title_sort small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9929221/
https://www.ncbi.nlm.nih.gov/pubmed/36788257
http://dx.doi.org/10.1038/s41598-023-29606-9
work_keys_str_mv AT chenyuan asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT liushangpeng asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT tongpeiran asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT huangying asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT tianhe asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT linfang asmalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT chenyuan smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT liushangpeng smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT tongpeiran smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT huangying smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT tianhe smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages
AT linfang smalldatasettraineddeeplearningframeworkforidentifyingatomsontransmissionelectronmicroscopyimages