Cargando…
X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Society of Photo-Optical Instrumentation Engineers
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932523/ https://www.ncbi.nlm.nih.gov/pubmed/36818584 http://dx.doi.org/10.1117/1.JBO.28.2.026004 |
_version_ | 1784889471483772928 |
---|---|
author | Feng, Jinchao Zhang, Hu Geng, Mengfan Chen, Hanliang Jia, Kebin Sun, Zhonghua Li, Zhe Cao, Xu Pogue, Brian W. |
author_facet | Feng, Jinchao Zhang, Hu Geng, Mengfan Chen, Hanliang Jia, Kebin Sun, Zhonghua Li, Zhe Cao, Xu Pogue, Brian W. |
author_sort | Feng, Jinchao |
collection | PubMed |
description | SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy. AIM: To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model. APPROACH: A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and in vivo experiments. RESULTS: This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ([Formula: see text]), peak signal-to-noise ratio ([Formula: see text]), and Pearson correlation ([Formula: see text]) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP. CONCLUSIONS: This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography. |
format | Online Article Text |
id | pubmed-9932523 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Society of Photo-Optical Instrumentation Engineers |
record_format | MEDLINE/PubMed |
spelling | pubmed-99325232023-02-17 X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module Feng, Jinchao Zhang, Hu Geng, Mengfan Chen, Hanliang Jia, Kebin Sun, Zhonghua Li, Zhe Cao, Xu Pogue, Brian W. J Biomed Opt Imaging SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy. AIM: To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model. APPROACH: A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and in vivo experiments. RESULTS: This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ([Formula: see text]), peak signal-to-noise ratio ([Formula: see text]), and Pearson correlation ([Formula: see text]) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP. CONCLUSIONS: This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography. Society of Photo-Optical Instrumentation Engineers 2023-02-16 2023-02 /pmc/articles/PMC9932523/ /pubmed/36818584 http://dx.doi.org/10.1117/1.JBO.28.2.026004 Text en © 2023 The Authors https://creativecommons.org/licenses/by/4.0/Published by SPIE under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI. |
spellingShingle | Imaging Feng, Jinchao Zhang, Hu Geng, Mengfan Chen, Hanliang Jia, Kebin Sun, Zhonghua Li, Zhe Cao, Xu Pogue, Brian W. X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title | X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title_full | X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title_fullStr | X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title_full_unstemmed | X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title_short | X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module |
title_sort | x-ray cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: swin transformer, convolutional neural network, and locality module |
topic | Imaging |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932523/ https://www.ncbi.nlm.nih.gov/pubmed/36818584 http://dx.doi.org/10.1117/1.JBO.28.2.026004 |
work_keys_str_mv | AT fengjinchao xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT zhanghu xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT gengmengfan xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT chenhanliang xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT jiakebin xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT sunzhonghua xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT lizhe xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT caoxu xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule AT poguebrianw xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule |