Cargando…
Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting
Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9952248/ https://www.ncbi.nlm.nih.gov/pubmed/36829679 http://dx.doi.org/10.3390/bioengineering10020184 |
_version_ | 1784893583535374336 |
---|---|
author | Chen, Lijiang Qiao, Changkun Wu, Meijing Cai, Linghan Yin, Cong Yang, Mukun Sang, Xiubo Bai, Wenpei |
author_facet | Chen, Lijiang Qiao, Changkun Wu, Meijing Cai, Linghan Yin, Cong Yang, Mukun Sang, Xiubo Bai, Wenpei |
author_sort | Chen, Lijiang |
collection | PubMed |
description | Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion’s boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. At a resolution of 512 × 512, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from [Formula: see text] to [Formula: see text] for the Unet model and from [Formula: see text] to [Formula: see text] for the PSPnet model in clean images. |
format | Online Article Text |
id | pubmed-9952248 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99522482023-02-25 Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting Chen, Lijiang Qiao, Changkun Wu, Meijing Cai, Linghan Yin, Cong Yang, Mukun Sang, Xiubo Bai, Wenpei Bioengineering (Basel) Article Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion’s boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. At a resolution of 512 × 512, our model achieved [Formula: see text] for SSIM, [Formula: see text] for FID, and [Formula: see text] for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from [Formula: see text] to [Formula: see text] for the Unet model and from [Formula: see text] to [Formula: see text] for the PSPnet model in clean images. MDPI 2023-02-01 /pmc/articles/PMC9952248/ /pubmed/36829679 http://dx.doi.org/10.3390/bioengineering10020184 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Lijiang Qiao, Changkun Wu, Meijing Cai, Linghan Yin, Cong Yang, Mukun Sang, Xiubo Bai, Wenpei Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title | Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title_full | Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title_fullStr | Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title_full_unstemmed | Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title_short | Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting |
title_sort | improving the segmentation accuracy of ovarian-tumor ultrasound images using image inpainting |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9952248/ https://www.ncbi.nlm.nih.gov/pubmed/36829679 http://dx.doi.org/10.3390/bioengineering10020184 |
work_keys_str_mv | AT chenlijiang improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT qiaochangkun improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT wumeijing improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT cailinghan improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT yincong improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT yangmukun improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT sangxiubo improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting AT baiwenpei improvingthesegmentationaccuracyofovariantumorultrasoundimagesusingimageinpainting |