Cargando…

Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation

Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable...

Descripción completa

Detalles Bibliográficos
Autores principales: Pai, Suraj, Hadzic, Ibrahim, Rao, Chinmay, Zhovannik, Ivan, Dekker, Andre, Traverso, Alberto, Asteriadis, Stylianos, Hortal, Enrique
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9920313/
https://www.ncbi.nlm.nih.gov/pubmed/36772129
http://dx.doi.org/10.3390/s23031089
_version_ 1784887039175426048
author Pai, Suraj
Hadzic, Ibrahim
Rao, Chinmay
Zhovannik, Ivan
Dekker, Andre
Traverso, Alberto
Asteriadis, Stylianos
Hortal, Enrique
author_facet Pai, Suraj
Hadzic, Ibrahim
Rao, Chinmay
Zhovannik, Ivan
Dekker, Andre
Traverso, Alberto
Asteriadis, Stylianos
Hortal, Enrique
author_sort Pai, Suraj
collection PubMed
description Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks.
format Online
Article
Text
id pubmed-9920313
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99203132023-02-12 Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation Pai, Suraj Hadzic, Ibrahim Rao, Chinmay Zhovannik, Ivan Dekker, Andre Traverso, Alberto Asteriadis, Stylianos Hortal, Enrique Sensors (Basel) Article Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks. MDPI 2023-01-17 /pmc/articles/PMC9920313/ /pubmed/36772129 http://dx.doi.org/10.3390/s23031089 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pai, Suraj
Hadzic, Ibrahim
Rao, Chinmay
Zhovannik, Ivan
Dekker, Andre
Traverso, Alberto
Asteriadis, Stylianos
Hortal, Enrique
Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title_full Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title_fullStr Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title_full_unstemmed Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title_short Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
title_sort frequency-domain-based structure losses for cyclegan-based cone-beam computed tomography translation
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9920313/
https://www.ncbi.nlm.nih.gov/pubmed/36772129
http://dx.doi.org/10.3390/s23031089
work_keys_str_mv AT paisuraj frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT hadzicibrahim frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT raochinmay frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT zhovannikivan frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT dekkerandre frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT traversoalberto frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT asteriadisstylianos frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation
AT hortalenrique frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation