Cargando…
A Novel Method for the Intelligent Recognition of Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation and Fuzzy Superpixels
[Image: see text] High-resolution transmission electron microscopy (HRTEM) can directly obtain the lattice fringes and structure parameters of coal. Aiming at present problems in extracting lattice fringes in HRTEM images, such as unlocated fringe regions, single-threshold segmentation, unclassified...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
American Chemical Society
2022
|
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089332/ https://www.ncbi.nlm.nih.gov/pubmed/35557657 http://dx.doi.org/10.1021/acsomega.2c00751 |
_version_ | 1784704493907083264 |
---|---|
author | Zhong, Jinzhi Meng, Yanjun Liu, Zehao Zeng, Fangui |
author_facet | Zhong, Jinzhi Meng, Yanjun Liu, Zehao Zeng, Fangui |
author_sort | Zhong, Jinzhi |
collection | PubMed |
description | [Image: see text] High-resolution transmission electron microscopy (HRTEM) can directly obtain the lattice fringes and structure parameters of coal. Aiming at present problems in extracting lattice fringes in HRTEM images, such as unlocated fringe regions, single-threshold segmentation, unclassified fuzzy superpixels, and tedious fringe pruning, an intelligent recognition method based on semantic segmentation, deep neural networks, fuzzy superpixels, and other algorithms is proposed. For unlocated fringe regions, the fringe regions are automatically localized with semantic segmentation. The whole semantic segmentation network adopts DeepLab V3+ based on ResNet to reduce unnecessary operations brought by non-fringe regions. For single-threshold segmentation of the image, the image is chunked before anything else. The genetic-optimized watershed algorithm is applied to divide the fringe base maps and non-fringe ones in order to avoid the distortion caused by different lights and shades of the image. For the fuzzy superpixels between the fringes and non-fringes, a similarity category judgment method based on neighboring pixels is proposed to solve the problem of unclassified fuzzy superpixels and to enrich and perfect the information of the lattice fringe base map. Eventually, as for lattice fringe overlap caused by coals piling together, a similarity judgment method based on the fringes’ characteristics is proposed to remove the bur portion of the lattice fringes and improve the pruning rate. Combining the above theories, a visualization tool based on MATLAB App Designer is designed, and the above four steps can be completed by this app to accurately display the results of coal aromatic lattice fringe identification in HRTEM images. Comparison with the lattice fringes drawn by leading experts shows that the fringes interpreted by this method are reliable. This method facilitates the extraction of lattice fringes in HRTEM, which lays the foundation for the labeling of HRTEM images in a variety of deep learning algorithms and facilitates the direct observation of coal structures by researchers. |
format | Online Article Text |
id | pubmed-9089332 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | American Chemical Society |
record_format | MEDLINE/PubMed |
spelling | pubmed-90893322022-05-11 A Novel Method for the Intelligent Recognition of Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation and Fuzzy Superpixels Zhong, Jinzhi Meng, Yanjun Liu, Zehao Zeng, Fangui ACS Omega [Image: see text] High-resolution transmission electron microscopy (HRTEM) can directly obtain the lattice fringes and structure parameters of coal. Aiming at present problems in extracting lattice fringes in HRTEM images, such as unlocated fringe regions, single-threshold segmentation, unclassified fuzzy superpixels, and tedious fringe pruning, an intelligent recognition method based on semantic segmentation, deep neural networks, fuzzy superpixels, and other algorithms is proposed. For unlocated fringe regions, the fringe regions are automatically localized with semantic segmentation. The whole semantic segmentation network adopts DeepLab V3+ based on ResNet to reduce unnecessary operations brought by non-fringe regions. For single-threshold segmentation of the image, the image is chunked before anything else. The genetic-optimized watershed algorithm is applied to divide the fringe base maps and non-fringe ones in order to avoid the distortion caused by different lights and shades of the image. For the fuzzy superpixels between the fringes and non-fringes, a similarity category judgment method based on neighboring pixels is proposed to solve the problem of unclassified fuzzy superpixels and to enrich and perfect the information of the lattice fringe base map. Eventually, as for lattice fringe overlap caused by coals piling together, a similarity judgment method based on the fringes’ characteristics is proposed to remove the bur portion of the lattice fringes and improve the pruning rate. Combining the above theories, a visualization tool based on MATLAB App Designer is designed, and the above four steps can be completed by this app to accurately display the results of coal aromatic lattice fringe identification in HRTEM images. Comparison with the lattice fringes drawn by leading experts shows that the fringes interpreted by this method are reliable. This method facilitates the extraction of lattice fringes in HRTEM, which lays the foundation for the labeling of HRTEM images in a variety of deep learning algorithms and facilitates the direct observation of coal structures by researchers. American Chemical Society 2022-04-19 /pmc/articles/PMC9089332/ /pubmed/35557657 http://dx.doi.org/10.1021/acsomega.2c00751 Text en © 2022 The Authors. Published by American Chemical Society https://creativecommons.org/licenses/by-nc-nd/4.0/Permits non-commercial access and re-use, provided that author attribution and integrity are maintained; but does not permit creation of adaptations or other derivative works (https://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Zhong, Jinzhi Meng, Yanjun Liu, Zehao Zeng, Fangui A Novel Method for the Intelligent Recognition of Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation and Fuzzy Superpixels |
title | A Novel Method for the Intelligent Recognition of
Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation
and Fuzzy Superpixels |
title_full | A Novel Method for the Intelligent Recognition of
Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation
and Fuzzy Superpixels |
title_fullStr | A Novel Method for the Intelligent Recognition of
Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation
and Fuzzy Superpixels |
title_full_unstemmed | A Novel Method for the Intelligent Recognition of
Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation
and Fuzzy Superpixels |
title_short | A Novel Method for the Intelligent Recognition of
Lattice Fringes in Coal HRTEM Images Based on Semantic Segmentation
and Fuzzy Superpixels |
title_sort | novel method for the intelligent recognition of
lattice fringes in coal hrtem images based on semantic segmentation
and fuzzy superpixels |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9089332/ https://www.ncbi.nlm.nih.gov/pubmed/35557657 http://dx.doi.org/10.1021/acsomega.2c00751 |
work_keys_str_mv | AT zhongjinzhi anovelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT mengyanjun anovelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT liuzehao anovelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT zengfangui anovelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT zhongjinzhi novelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT mengyanjun novelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT liuzehao novelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels AT zengfangui novelmethodfortheintelligentrecognitionoflatticefringesincoalhrtemimagesbasedonsemanticsegmentationandfuzzysuperpixels |