Cargando…

A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network

MOTIVATION: The registration of serial section electron microscope images is a critical step in reconstructing biological tissue volumes, and it aims to eliminate complex nonlinear deformations from sectioning and replicate the correct neurite structure. However, due to the inherent properties of bi...

Descripción completa

Detalles Bibliográficos
Autores principales: Xin, Tong, Lv, Yanan, Chen, Haoran, Li, Linlin, Shen, Lijun, Shan, Guangcun, Chen, Xi, Han, Hua
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403427/
https://www.ncbi.nlm.nih.gov/pubmed/37462605
http://dx.doi.org/10.1093/bioinformatics/btad436
_version_ 1785085066358030336
author Xin, Tong
Lv, Yanan
Chen, Haoran
Li, Linlin
Shen, Lijun
Shan, Guangcun
Chen, Xi
Han, Hua
author_facet Xin, Tong
Lv, Yanan
Chen, Haoran
Li, Linlin
Shen, Lijun
Shan, Guangcun
Chen, Xi
Han, Hua
author_sort Xin, Tong
collection PubMed
description MOTIVATION: The registration of serial section electron microscope images is a critical step in reconstructing biological tissue volumes, and it aims to eliminate complex nonlinear deformations from sectioning and replicate the correct neurite structure. However, due to the inherent properties of biological structures and the challenges posed by section preparation of biological tissues, achieving an accurate registration of serial sections remains a significant challenge. Conventional nonlinear registration techniques, which are effective in eliminating nonlinear deformation, can also eliminate the natural morphological variation of neurites across sections. Additionally, accumulation of registration errors alters the neurite structure. RESULTS: This article proposes a novel method for serial section registration that utilizes an unsupervised optical flow network to measure feature similarity rather than pixel similarity to eliminate nonlinear deformation and achieve pairwise registration between sections. The optical flow network is then employed to estimate and compensate for cumulative registration error, thereby allowing for the reconstruction of the structure of biological tissues. Based on the novel serial section registration method, a serial split technique is proposed for long-serial sections. Experimental results demonstrate that the state-of-the-art method proposed here effectively improves the spatial continuity of serial sections, leading to more accurate registration and improved reconstruction of the structure of biological tissues. AVAILABILITY AND IMPLEMENTATION: The source code and data are available at https://github.com/TongXin-CASIA/EFSR.
format Online
Article
Text
id pubmed-10403427
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-104034272023-08-06 A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network Xin, Tong Lv, Yanan Chen, Haoran Li, Linlin Shen, Lijun Shan, Guangcun Chen, Xi Han, Hua Bioinformatics Original Paper MOTIVATION: The registration of serial section electron microscope images is a critical step in reconstructing biological tissue volumes, and it aims to eliminate complex nonlinear deformations from sectioning and replicate the correct neurite structure. However, due to the inherent properties of biological structures and the challenges posed by section preparation of biological tissues, achieving an accurate registration of serial sections remains a significant challenge. Conventional nonlinear registration techniques, which are effective in eliminating nonlinear deformation, can also eliminate the natural morphological variation of neurites across sections. Additionally, accumulation of registration errors alters the neurite structure. RESULTS: This article proposes a novel method for serial section registration that utilizes an unsupervised optical flow network to measure feature similarity rather than pixel similarity to eliminate nonlinear deformation and achieve pairwise registration between sections. The optical flow network is then employed to estimate and compensate for cumulative registration error, thereby allowing for the reconstruction of the structure of biological tissues. Based on the novel serial section registration method, a serial split technique is proposed for long-serial sections. Experimental results demonstrate that the state-of-the-art method proposed here effectively improves the spatial continuity of serial sections, leading to more accurate registration and improved reconstruction of the structure of biological tissues. AVAILABILITY AND IMPLEMENTATION: The source code and data are available at https://github.com/TongXin-CASIA/EFSR. Oxford University Press 2023-07-18 /pmc/articles/PMC10403427/ /pubmed/37462605 http://dx.doi.org/10.1093/bioinformatics/btad436 Text en © The Author(s) 2023. Published by Oxford University Press. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Paper
Xin, Tong
Lv, Yanan
Chen, Haoran
Li, Linlin
Shen, Lijun
Shan, Guangcun
Chen, Xi
Han, Hua
A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title_full A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title_fullStr A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title_full_unstemmed A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title_short A novel registration method for long-serial section images of EM with a serial split technique based on unsupervised optical flow network
title_sort novel registration method for long-serial section images of em with a serial split technique based on unsupervised optical flow network
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403427/
https://www.ncbi.nlm.nih.gov/pubmed/37462605
http://dx.doi.org/10.1093/bioinformatics/btad436
work_keys_str_mv AT xintong anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT lvyanan anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT chenhaoran anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT lilinlin anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT shenlijun anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT shanguangcun anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT chenxi anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT hanhua anovelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT xintong novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT lvyanan novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT chenhaoran novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT lilinlin novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT shenlijun novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT shanguangcun novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT chenxi novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork
AT hanhua novelregistrationmethodforlongserialsectionimagesofemwithaserialsplittechniquebasedonunsupervisedopticalflownetwork