Cargando…
A deep learning-based stripe self-correction method for stitched microscopic images
Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correc...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10480181/ https://www.ncbi.nlm.nih.gov/pubmed/37669977 http://dx.doi.org/10.1038/s41467-023-41165-1 |
_version_ | 1785101735838089216 |
---|---|
author | Wang, Shu Liu, Xiaoxiang Li, Yueying Sun, Xinquan Li, Qi She, Yinhua Xu, Yixuan Huang, Xingxin Lin, Ruolan Kang, Deyong Wang, Xingfu Tu, Haohua Liu, Wenxi Huang, Feng Chen, Jianxin |
author_facet | Wang, Shu Liu, Xiaoxiang Li, Yueying Sun, Xinquan Li, Qi She, Yinhua Xu, Yixuan Huang, Xingxin Lin, Ruolan Kang, Deyong Wang, Xingfu Tu, Haohua Liu, Wenxi Huang, Feng Chen, Jianxin |
author_sort | Wang, Shu |
collection | PubMed |
description | Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers. |
format | Online Article Text |
id | pubmed-10480181 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-104801812023-09-07 A deep learning-based stripe self-correction method for stitched microscopic images Wang, Shu Liu, Xiaoxiang Li, Yueying Sun, Xinquan Li, Qi She, Yinhua Xu, Yixuan Huang, Xingxin Lin, Ruolan Kang, Deyong Wang, Xingfu Tu, Haohua Liu, Wenxi Huang, Feng Chen, Jianxin Nat Commun Article Stitched fluorescence microscope images inevitably exist in various types of stripes or artifacts caused by uncertain factors such as optical devices or specimens, which severely affects the image quality and downstream quantitative analysis. Here, we present a deep learning-based Stripe Self-Correction method, so-called SSCOR. Specifically, we propose a proximity sampling scheme and adversarial reciprocal self-training paradigm that enable SSCOR to utilize stripe-free patches sampled from the stitched microscope image itself to correct their adjacent stripe patches. Comparing to off-the-shelf approaches, SSCOR can not only adaptively correct non-uniform, oblique, and grid stripes, but also remove scanning, bubble, and out-of-focus artifacts, achieving the state-of-the-art performance across different imaging conditions and modalities. Moreover, SSCOR does not require any physical parameter estimation, patch-wise manual annotation, or raw stitched information in the correction process. This provides an intelligent prior-free image restoration solution for microscopists or even microscope companies, thus ensuring more precise biomedical applications for researchers. Nature Publishing Group UK 2023-09-05 /pmc/articles/PMC10480181/ /pubmed/37669977 http://dx.doi.org/10.1038/s41467-023-41165-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Wang, Shu Liu, Xiaoxiang Li, Yueying Sun, Xinquan Li, Qi She, Yinhua Xu, Yixuan Huang, Xingxin Lin, Ruolan Kang, Deyong Wang, Xingfu Tu, Haohua Liu, Wenxi Huang, Feng Chen, Jianxin A deep learning-based stripe self-correction method for stitched microscopic images |
title | A deep learning-based stripe self-correction method for stitched microscopic images |
title_full | A deep learning-based stripe self-correction method for stitched microscopic images |
title_fullStr | A deep learning-based stripe self-correction method for stitched microscopic images |
title_full_unstemmed | A deep learning-based stripe self-correction method for stitched microscopic images |
title_short | A deep learning-based stripe self-correction method for stitched microscopic images |
title_sort | deep learning-based stripe self-correction method for stitched microscopic images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10480181/ https://www.ncbi.nlm.nih.gov/pubmed/37669977 http://dx.doi.org/10.1038/s41467-023-41165-1 |
work_keys_str_mv | AT wangshu adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liuxiaoxiang adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liyueying adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT sunxinquan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liqi adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT sheyinhua adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT xuyixuan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT huangxingxin adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT linruolan adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT kangdeyong adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT wangxingfu adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT tuhaohua adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liuwenxi adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT huangfeng adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT chenjianxin adeeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT wangshu deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liuxiaoxiang deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liyueying deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT sunxinquan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liqi deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT sheyinhua deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT xuyixuan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT huangxingxin deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT linruolan deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT kangdeyong deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT wangxingfu deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT tuhaohua deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT liuwenxi deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT huangfeng deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages AT chenjianxin deeplearningbasedstripeselfcorrectionmethodforstitchedmicroscopicimages |