Cargando…

Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting

Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Lijiang, Qiao, Changkun, Wu, Meijing, Cai, Linghan, Yin, Cong, Yang, Mukun, Sang, Xiubo, Bai, Wenpei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9952248/
https://www.ncbi.nlm.nih.gov/pubmed/36829679
http://dx.doi.org/10.3390/bioengineering10020184
_version_ 1784893583535374336
author Chen, Lijiang
Qiao, Changkun
Wu, Meijing
Cai, Linghan
Yin, Cong
Yang, Mukun
Sang, Xiubo
Bai, Wenpei
author_facet Chen, Lijiang
Qiao, Changkun
Wu, Meijing
Cai, Linghan
Yin, Cong
Yang, Mukun
Sang, Xiubo
Bai, Wenpei
author_sort Chen, Lijiang
collection PubMed
description Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion’s boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. At a resolution of 512 × 512, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from [Formula: see text] to [Formula: see text] for the Unet model and from [Formula: see text] to [Formula: see text] for the PSPnet model in clean images.
format Online
Article
Text
id pubmed-9952248
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99522482023-02-25 Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting Chen, Lijiang Qiao, Changkun Wu, Meijing Cai, Linghan Yin, Cong Yang, Mukun Sang, Xiubo Bai, Wenpei Bioengineering (Basel) Article Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion’s boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. At a resolution of 512 × 512, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from [Formula: see text] to [Formula: see text] for the Unet model and from [Formula: see text] to [Formula: see text] for the PSPnet model in clean images. MDPI 2023-02-01 /pmc/articles/PMC9952248/ /pubmed/36829679 http://dx.doi.org/10.3390/bioengineering10020184 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chen, Lijiang
Qiao, Changkun
Wu, Meijing
Cai, Linghan
Yin, Cong
Yang, Mukun
Sang, Xiubo
Bai, Wenpei
Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title_full Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title_fullStr Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title_full_unstemmed Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title_short Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
title_sort improving the segmentation accuracy of ovarian-tumor ultrasound images using image inpainting
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9952248/
https://www.ncbi.nlm.nih.gov/pubmed/36829679
http://dx.doi.org/10.3390/bioengineering10020184
work_keys_str_mv AT chenlijiang improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT qiaochangkun improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT wumeijing improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT cailinghan improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT yincong improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT yangmukun improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT sangxiubo improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting
AT baiwenpei improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting