Cargando…

End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration

OBJECTIVE: To improve the efficiency of computed tomography (CT)‐magnetic resonance (MR) deformable image registration while ensuring the registration accuracy. METHODS: Two fully convolutional networks (FCNs) for generating spatial deformable grids were proposed using the Cycle‐Consistent method to...

Descripción completa

Detalles Bibliográficos
Autores principales: Guo, Yi, Wu, Xiangyi, Wang, Zhi, Pei, Xi, Xu, X. George
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7497923/
https://www.ncbi.nlm.nih.gov/pubmed/32657533
http://dx.doi.org/10.1002/acm2.12968
_version_ 1783583407889973248
author Guo, Yi
Wu, Xiangyi
Wang, Zhi
Pei, Xi
Xu, X. George
author_facet Guo, Yi
Wu, Xiangyi
Wang, Zhi
Pei, Xi
Xu, X. George
author_sort Guo, Yi
collection PubMed
description OBJECTIVE: To improve the efficiency of computed tomography (CT)‐magnetic resonance (MR) deformable image registration while ensuring the registration accuracy. METHODS: Two fully convolutional networks (FCNs) for generating spatial deformable grids were proposed using the Cycle‐Consistent method to ensure the deformed image consistency with the reference image data. In all, 74 pelvic cases consisting of both MR and CT images were studied, among which 64 cases were used as training data and 10 cases as the testing data. All training data were standardized and normalized, following simple image preparation to remove the redundant air. Dice coefficients and average surface distance (ASD) were calculated for regions of interest (ROI) of CT‐MR image pairs, before and after the registration. The performance of the proposed method (FCN with Cycle‐Consistent) was compared with that of Elastix software, MIM software, and FCN without cycle‐consistent. RESULTS: The results show that the proposed method achieved the best performance among the four registration methods tested in terms of registration accuracy and the method was more stable than others in general. In terms of average registration time, Elastix took 64 s, MIM software took 28 s, and the proposed method was found to be significantly faster, taking <0.1 s. CONCLUSION: The proposed method not only ensures the accuracy of deformable image registration but also greatly reduces the time required for image registration and improves the efficiency of the registration process. In addition, compared with other deep learning methods, the proposed method is completely unsupervised and end‐to‐end.
format Online
Article
Text
id pubmed-7497923
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-74979232020-09-25 End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration Guo, Yi Wu, Xiangyi Wang, Zhi Pei, Xi Xu, X. George J Appl Clin Med Phys Medical Imaging OBJECTIVE: To improve the efficiency of computed tomography (CT)‐magnetic resonance (MR) deformable image registration while ensuring the registration accuracy. METHODS: Two fully convolutional networks (FCNs) for generating spatial deformable grids were proposed using the Cycle‐Consistent method to ensure the deformed image consistency with the reference image data. In all, 74 pelvic cases consisting of both MR and CT images were studied, among which 64 cases were used as training data and 10 cases as the testing data. All training data were standardized and normalized, following simple image preparation to remove the redundant air. Dice coefficients and average surface distance (ASD) were calculated for regions of interest (ROI) of CT‐MR image pairs, before and after the registration. The performance of the proposed method (FCN with Cycle‐Consistent) was compared with that of Elastix software, MIM software, and FCN without cycle‐consistent. RESULTS: The results show that the proposed method achieved the best performance among the four registration methods tested in terms of registration accuracy and the method was more stable than others in general. In terms of average registration time, Elastix took 64 s, MIM software took 28 s, and the proposed method was found to be significantly faster, taking <0.1 s. CONCLUSION: The proposed method not only ensures the accuracy of deformable image registration but also greatly reduces the time required for image registration and improves the efficiency of the registration process. In addition, compared with other deep learning methods, the proposed method is completely unsupervised and end‐to‐end. John Wiley and Sons Inc. 2020-07-13 /pmc/articles/PMC7497923/ /pubmed/32657533 http://dx.doi.org/10.1002/acm2.12968 Text en © 2020 The Authors. Journal of Applied Clinical Medical Physics published by Wiley Periodicals, Inc. on behalf of American Association of Physicists in Medicine. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Medical Imaging
Guo, Yi
Wu, Xiangyi
Wang, Zhi
Pei, Xi
Xu, X. George
End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title_full End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title_fullStr End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title_full_unstemmed End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title_short End‐to‐end unsupervised cycle‐consistent fully convolutional network for 3D pelvic CT‐MR deformable registration
title_sort end‐to‐end unsupervised cycle‐consistent fully convolutional network for 3d pelvic ct‐mr deformable registration
topic Medical Imaging
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7497923/
https://www.ncbi.nlm.nih.gov/pubmed/32657533
http://dx.doi.org/10.1002/acm2.12968
work_keys_str_mv AT guoyi endtoendunsupervisedcycleconsistentfullyconvolutionalnetworkfor3dpelvicctmrdeformableregistration
AT wuxiangyi endtoendunsupervisedcycleconsistentfullyconvolutionalnetworkfor3dpelvicctmrdeformableregistration
AT wangzhi endtoendunsupervisedcycleconsistentfullyconvolutionalnetworkfor3dpelvicctmrdeformableregistration
AT peixi endtoendunsupervisedcycleconsistentfullyconvolutionalnetworkfor3dpelvicctmrdeformableregistration
AT xuxgeorge endtoendunsupervisedcycleconsistentfullyconvolutionalnetworkfor3dpelvicctmrdeformableregistration