Cargando…

X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module

SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can...

Descripción completa

Detalles Bibliográficos
Autores principales: Feng, Jinchao, Zhang, Hu, Geng, Mengfan, Chen, Hanliang, Jia, Kebin, Sun, Zhonghua, Li, Zhe, Cao, Xu, Pogue, Brian W.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Society of Photo-Optical Instrumentation Engineers 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932523/
https://www.ncbi.nlm.nih.gov/pubmed/36818584
http://dx.doi.org/10.1117/1.JBO.28.2.026004
_version_ 1784889471483772928
author Feng, Jinchao
Zhang, Hu
Geng, Mengfan
Chen, Hanliang
Jia, Kebin
Sun, Zhonghua
Li, Zhe
Cao, Xu
Pogue, Brian W.
author_facet Feng, Jinchao
Zhang, Hu
Geng, Mengfan
Chen, Hanliang
Jia, Kebin
Sun, Zhonghua
Li, Zhe
Cao, Xu
Pogue, Brian W.
author_sort Feng, Jinchao
collection PubMed
description SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy. AIM: To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model. APPROACH: A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and in vivo experiments. RESULTS: This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ([Formula: see text]), peak signal-to-noise ratio ([Formula: see text]), and Pearson correlation ([Formula: see text]) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP. CONCLUSIONS: This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography.
format Online
Article
Text
id pubmed-9932523
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Society of Photo-Optical Instrumentation Engineers
record_format MEDLINE/PubMed
spelling pubmed-99325232023-02-17 X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module Feng, Jinchao Zhang, Hu Geng, Mengfan Chen, Hanliang Jia, Kebin Sun, Zhonghua Li, Zhe Cao, Xu Pogue, Brian W. J Biomed Opt Imaging SIGNIFICANCE: X-ray Cherenkov–luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy. AIM: To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model. APPROACH: A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and in vivo experiments. RESULTS: This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ([Formula: see text]), peak signal-to-noise ratio ([Formula: see text]), and Pearson correlation ([Formula: see text]) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP. CONCLUSIONS: This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography. Society of Photo-Optical Instrumentation Engineers 2023-02-16 2023-02 /pmc/articles/PMC9932523/ /pubmed/36818584 http://dx.doi.org/10.1117/1.JBO.28.2.026004 Text en © 2023 The Authors https://creativecommons.org/licenses/by/4.0/Published by SPIE under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
spellingShingle Imaging
Feng, Jinchao
Zhang, Hu
Geng, Mengfan
Chen, Hanliang
Jia, Kebin
Sun, Zhonghua
Li, Zhe
Cao, Xu
Pogue, Brian W.
X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title_full X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title_fullStr X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title_full_unstemmed X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title_short X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module
title_sort x-ray cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: swin transformer, convolutional neural network, and locality module
topic Imaging
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9932523/
https://www.ncbi.nlm.nih.gov/pubmed/36818584
http://dx.doi.org/10.1117/1.JBO.28.2.026004
work_keys_str_mv AT fengjinchao xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT zhanghu xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT gengmengfan xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT chenhanliang xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT jiakebin xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT sunzhonghua xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT lizhe xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT caoxu xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule
AT poguebrianw xraycherenkovluminescencetomographyreconstructionwithathreecomponentdeeplearningalgorithmswintransformerconvolutionalneuralnetworkandlocalitymodule