Cargando…

A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery

BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot t...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Jianguo, Shen, Jianxin, Wan, Cheng, Jiang, Qin, Yan, Zhipeng, Yang, Weihua
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927682/
https://www.ncbi.nlm.nih.gov/pubmed/35308538
http://dx.doi.org/10.3389/fmed.2022.821565
_version_ 1784670495787974656
author Xu, Jianguo
Shen, Jianxin
Wan, Cheng
Jiang, Qin
Yan, Zhipeng
Yang, Weihua
author_facet Xu, Jianguo
Shen, Jianxin
Wan, Cheng
Jiang, Qin
Yan, Zhipeng
Yang, Weihua
author_sort Xu, Jianguo
collection PubMed
description BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly. METHODS: This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models. RESULTS: Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models.
format Online
Article
Text
id pubmed-8927682
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-89276822022-03-18 A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery Xu, Jianguo Shen, Jianxin Wan, Cheng Jiang, Qin Yan, Zhipeng Yang, Weihua Front Med (Lausanne) Medicine BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly. METHODS: This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models. RESULTS: Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models. Frontiers Media S.A. 2022-03-03 /pmc/articles/PMC8927682/ /pubmed/35308538 http://dx.doi.org/10.3389/fmed.2022.821565 Text en Copyright © 2022 Xu, Shen, Wan, Jiang, Yan and Yang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Medicine
Xu, Jianguo
Shen, Jianxin
Wan, Cheng
Jiang, Qin
Yan, Zhipeng
Yang, Weihua
A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title_full A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title_fullStr A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title_full_unstemmed A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title_short A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
title_sort few-shot learning-based retinal vessel segmentation method for assisting in the central serous chorioretinopathy laser surgery
topic Medicine
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927682/
https://www.ncbi.nlm.nih.gov/pubmed/35308538
http://dx.doi.org/10.3389/fmed.2022.821565
work_keys_str_mv AT xujianguo afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT shenjianxin afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT wancheng afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT jiangqin afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT yanzhipeng afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT yangweihua afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT xujianguo fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT shenjianxin fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT wancheng fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT jiangqin fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT yanzhipeng fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery
AT yangweihua fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery