Cargando…
A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery
BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot t...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927682/ https://www.ncbi.nlm.nih.gov/pubmed/35308538 http://dx.doi.org/10.3389/fmed.2022.821565 |
_version_ | 1784670495787974656 |
---|---|
author | Xu, Jianguo Shen, Jianxin Wan, Cheng Jiang, Qin Yan, Zhipeng Yang, Weihua |
author_facet | Xu, Jianguo Shen, Jianxin Wan, Cheng Jiang, Qin Yan, Zhipeng Yang, Weihua |
author_sort | Xu, Jianguo |
collection | PubMed |
description | BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly. METHODS: This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models. RESULTS: Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models. |
format | Online Article Text |
id | pubmed-8927682 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-89276822022-03-18 A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery Xu, Jianguo Shen, Jianxin Wan, Cheng Jiang, Qin Yan, Zhipeng Yang, Weihua Front Med (Lausanne) Medicine BACKGROUND: The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly. METHODS: This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models. RESULTS: Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models. Frontiers Media S.A. 2022-03-03 /pmc/articles/PMC8927682/ /pubmed/35308538 http://dx.doi.org/10.3389/fmed.2022.821565 Text en Copyright © 2022 Xu, Shen, Wan, Jiang, Yan and Yang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Medicine Xu, Jianguo Shen, Jianxin Wan, Cheng Jiang, Qin Yan, Zhipeng Yang, Weihua A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title | A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title_full | A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title_fullStr | A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title_full_unstemmed | A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title_short | A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery |
title_sort | few-shot learning-based retinal vessel segmentation method for assisting in the central serous chorioretinopathy laser surgery |
topic | Medicine |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8927682/ https://www.ncbi.nlm.nih.gov/pubmed/35308538 http://dx.doi.org/10.3389/fmed.2022.821565 |
work_keys_str_mv | AT xujianguo afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT shenjianxin afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT wancheng afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT jiangqin afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT yanzhipeng afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT yangweihua afewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT xujianguo fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT shenjianxin fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT wancheng fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT jiangqin fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT yanzhipeng fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery AT yangweihua fewshotlearningbasedretinalvesselsegmentationmethodforassistinginthecentralserouschorioretinopathylasersurgery |