Cargando…

Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring

Serial scanning electron microscopy (sSEM) has recently been developed to reconstruct complex largescale neural connectomes, through learning-based instance segmentation. However, blurry images are inevitable amid prolonged automated data acquisition due to imprecision in autofocusing and autostigma...

Descripción completa

Detalles Bibliográficos
Autores principales: Cheng, Ao, Kang, Kai, Zhu, Zhanpeng, Zhang, Ruobing, Wang, Lirong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9879678/
https://www.ncbi.nlm.nih.gov/pubmed/36711194
http://dx.doi.org/10.1155/2023/8936903
_version_ 1784878744736890880
author Cheng, Ao
Kang, Kai
Zhu, Zhanpeng
Zhang, Ruobing
Wang, Lirong
author_facet Cheng, Ao
Kang, Kai
Zhu, Zhanpeng
Zhang, Ruobing
Wang, Lirong
author_sort Cheng, Ao
collection PubMed
description Serial scanning electron microscopy (sSEM) has recently been developed to reconstruct complex largescale neural connectomes, through learning-based instance segmentation. However, blurry images are inevitable amid prolonged automated data acquisition due to imprecision in autofocusing and autostigmation, which impose a great challenge to accurate segmentation of the massive sSEM image data. Recently, learning-based methods, such as adversarial learning and supervised learning, have been proven to be effective for blind EM image deblurring. However, in practice, these methods suffer from the limited training dataset and the underrepresentation of high-resolution decoded features. Here, we propose a semisupervised learning guided progressive decoding network (SGPN) to exploit unlabeled blurry images for training and progressively enrich high-resolution feature representation. The proposed method outperforms the latest deblurring models on real SEM images with much less ground truth input. The improvement of the PSNR and SSIM is 1.04 dB and 0.086, respectively. We then trained segmentation models with deblurred datasets and demonstrated significant improvement in segmentation accuracy. The A-rand (Bogovic et al. 2013) decreased by 0.119 and 0.026, respectively, for 2D and 3D segmentation.
format Online
Article
Text
id pubmed-9879678
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-98796782023-01-27 Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring Cheng, Ao Kang, Kai Zhu, Zhanpeng Zhang, Ruobing Wang, Lirong Comput Intell Neurosci Research Article Serial scanning electron microscopy (sSEM) has recently been developed to reconstruct complex largescale neural connectomes, through learning-based instance segmentation. However, blurry images are inevitable amid prolonged automated data acquisition due to imprecision in autofocusing and autostigmation, which impose a great challenge to accurate segmentation of the massive sSEM image data. Recently, learning-based methods, such as adversarial learning and supervised learning, have been proven to be effective for blind EM image deblurring. However, in practice, these methods suffer from the limited training dataset and the underrepresentation of high-resolution decoded features. Here, we propose a semisupervised learning guided progressive decoding network (SGPN) to exploit unlabeled blurry images for training and progressively enrich high-resolution feature representation. The proposed method outperforms the latest deblurring models on real SEM images with much less ground truth input. The improvement of the PSNR and SSIM is 1.04 dB and 0.086, respectively. We then trained segmentation models with deblurred datasets and demonstrated significant improvement in segmentation accuracy. The A-rand (Bogovic et al. 2013) decreased by 0.119 and 0.026, respectively, for 2D and 3D segmentation. Hindawi 2023-01-17 /pmc/articles/PMC9879678/ /pubmed/36711194 http://dx.doi.org/10.1155/2023/8936903 Text en Copyright © 2023 Ao Cheng et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Cheng, Ao
Kang, Kai
Zhu, Zhanpeng
Zhang, Ruobing
Wang, Lirong
Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title_full Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title_fullStr Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title_full_unstemmed Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title_short Improving the Neural Segmentation of Blurry Serial SEM Images by Blind Deblurring
title_sort improving the neural segmentation of blurry serial sem images by blind deblurring
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9879678/
https://www.ncbi.nlm.nih.gov/pubmed/36711194
http://dx.doi.org/10.1155/2023/8936903
work_keys_str_mv AT chengao improvingtheneuralsegmentationofblurryserialsemimagesbyblinddeblurring
AT kangkai improvingtheneuralsegmentationofblurryserialsemimagesbyblinddeblurring
AT zhuzhanpeng improvingtheneuralsegmentationofblurryserialsemimagesbyblinddeblurring
AT zhangruobing improvingtheneuralsegmentationofblurryserialsemimagesbyblinddeblurring
AT wanglirong improvingtheneuralsegmentationofblurryserialsemimagesbyblinddeblurring