Cargando…

A deep learning-based stripe self-correction method for stitched microscopic images

Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correc...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shu, Liu, Xiaoxiang, Li, Yueying, Sun, Xinquan, Li, Qi, She, Yinhua, Xu, Yixuan, Huang, Xingxin, Lin, Ruolan, Kang, Deyong, Wang, Xingfu, Tu, Haohua, Liu, Wenxi, Huang, Feng, Chen, Jianxin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10480181/
https://www.ncbi.nlm.nih.gov/pubmed/37669977
http://dx.doi.org/10.1038/s41467-023-41165-1
_version_ 1785101735838089216
author Wang, Shu
Liu, Xiaoxiang
Li, Yueying
Sun, Xinquan
Li, Qi
She, Yinhua
Xu, Yixuan
Huang, Xingxin
Lin, Ruolan
Kang, Deyong
Wang, Xingfu
Tu, Haohua
Liu, Wenxi
Huang, Feng
Chen, Jianxin
author_facet Wang, Shu
Liu, Xiaoxiang
Li, Yueying
Sun, Xinquan
Li, Qi
She, Yinhua
Xu, Yixuan
Huang, Xingxin
Lin, Ruolan
Kang, Deyong
Wang, Xingfu
Tu, Haohua
Liu, Wenxi
Huang, Feng
Chen, Jianxin
author_sort Wang, Shu
collection PubMed
description Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers.
format Online
Article
Text
id pubmed-10480181
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-104801812023-09-07 A deep learning-based stripe self-correction method for stitched microscopic images Wang, Shu Liu, Xiaoxiang Li, Yueying Sun, Xinquan Li, Qi She, Yinhua Xu, Yixuan Huang, Xingxin Lin, Ruolan Kang, Deyong Wang, Xingfu Tu, Haohua Liu, Wenxi Huang, Feng Chen, Jianxin Nat Commun Article Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers. Nature Publishing Group UK 2023-09-05 /pmc/articles/PMC10480181/ /pubmed/37669977 http://dx.doi.org/10.1038/s41467-023-41165-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Wang, Shu
Liu, Xiaoxiang
Li, Yueying
Sun, Xinquan
Li, Qi
She, Yinhua
Xu, Yixuan
Huang, Xingxin
Lin, Ruolan
Kang, Deyong
Wang, Xingfu
Tu, Haohua
Liu, Wenxi
Huang, Feng
Chen, Jianxin
A deep learning-based stripe self-correction method for stitched microscopic images
title A deep learning-based stripe self-correction method for stitched microscopic images
title_full A deep learning-based stripe self-correction method for stitched microscopic images
title_fullStr A deep learning-based stripe self-correction method for stitched microscopic images
title_full_unstemmed A deep learning-based stripe self-correction method for stitched microscopic images
title_short A deep learning-based stripe self-correction method for stitched microscopic images
title_sort deep learning-based stripe self-correction method for stitched microscopic images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10480181/
https://www.ncbi.nlm.nih.gov/pubmed/37669977
http://dx.doi.org/10.1038/s41467-023-41165-1
work_keys_str_mv AT wangshu adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liuxiaoxiang adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liyueying adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT sunxinquan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liqi adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT sheyinhua adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT xuyixuan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT huangxingxin adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT linruolan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT kangdeyong adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT wangxingfu adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT tuhaohua adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liuwenxi adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT huangfeng adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT chenjianxin adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT wangshu deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liuxiaoxiang deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liyueying deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT sunxinquan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liqi deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT sheyinhua deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT xuyixuan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT huangxingxin deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT linruolan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT kangdeyong deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT wangxingfu deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT tuhaohua deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT liuwenxi deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT huangfeng deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages
AT chenjianxin deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages