Cargando…
Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation
Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9920313/ https://www.ncbi.nlm.nih.gov/pubmed/36772129 http://dx.doi.org/10.3390/s23031089 |
_version_ | 1784887039175426048 |
---|---|
author | Pai, Suraj Hadzic, Ibrahim Rao, Chinmay Zhovannik, Ivan Dekker, Andre Traverso, Alberto Asteriadis, Stylianos Hortal, Enrique |
author_facet | Pai, Suraj Hadzic, Ibrahim Rao, Chinmay Zhovannik, Ivan Dekker, Andre Traverso, Alberto Asteriadis, Stylianos Hortal, Enrique |
author_sort | Pai, Suraj |
collection | PubMed |
description | Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks. |
format | Online Article Text |
id | pubmed-9920313 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99203132023-02-12 Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation Pai, Suraj Hadzic, Ibrahim Rao, Chinmay Zhovannik, Ivan Dekker, Andre Traverso, Alberto Asteriadis, Stylianos Hortal, Enrique Sensors (Basel) Article Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks. MDPI 2023-01-17 /pmc/articles/PMC9920313/ /pubmed/36772129 http://dx.doi.org/10.3390/s23031089 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Pai, Suraj Hadzic, Ibrahim Rao, Chinmay Zhovannik, Ivan Dekker, Andre Traverso, Alberto Asteriadis, Stylianos Hortal, Enrique Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title | Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title_full | Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title_fullStr | Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title_full_unstemmed | Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title_short | Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation |
title_sort | frequency-domain-based structure losses for cyclegan-based cone-beam computed tomography translation |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9920313/ https://www.ncbi.nlm.nih.gov/pubmed/36772129 http://dx.doi.org/10.3390/s23031089 |
work_keys_str_mv | AT paisuraj frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT hadzicibrahim frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT raochinmay frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT zhovannikivan frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT dekkerandre frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT traversoalberto frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT asteriadisstylianos frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation AT hortalenrique frequencydomainbasedstructurelossesforcycleganbasedconebeamcomputedtomographytranslation |