Cargando…
A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, an...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10507331/ https://www.ncbi.nlm.nih.gov/pubmed/37731631 http://dx.doi.org/10.3389/fonc.2023.1223353 |
_version_ | 1785107292958490624 |
---|---|
author | Luo, Yang Wang, Yingwei Zhao, Yongda Guan, Wei Shi, Hanfeng Fu, Chong Jiang, Hongyang |
author_facet | Luo, Yang Wang, Yingwei Zhao, Yongda Guan, Wei Shi, Hanfeng Fu, Chong Jiang, Hongyang |
author_sort | Luo, Yang |
collection | PubMed |
description | INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, and diagnostic accuracy is also closely related to experts' experience, fatigue and mood and so on. Besides, fully automatic white blood cells segmentation is challenging for several reasons. There exists cell deformation, blurred cell boundaries, and cell color differences, cells overlapping or adhesion. METHODS: The proposed method improves the feature representation capability of the network while reducing parameters and computational redundancy by utilizing the feature reuse of Ghost module to reconstruct a lightweight backbone network. Additionally, a dual-stream feature fusion network (DFFN) based on the feature pyramid network is designed to enhance detailed information acquisition. Furthermore, a dual-domain attention module (DDAM) is developed to extract global features from both frequency and spatial domains simultaneously, resulting in better cell segmentation performance. RESULTS: Experimental results on ALL-IDB and BCCD datasets demonstrate that our method outperforms existing instance segmentation networks such as Mask R-CNN, PointRend, MS R-CNN, SOLOv2, and YOLACT with an average precision (AP) of 87.41%, while significantly reducing parameters and computational cost. DISCUSSION: Our method is significantly better than the current state-of-the-art single-stage methods in terms of both the number of parameters and FLOPs, and our method has the best performance among all compared methods. However, the performance of our method is still lower than the two-stage instance segmentation algorithms. in future work, how to design a more lightweight network model while ensuring a good accuracy will become an important problem. |
format | Online Article Text |
id | pubmed-10507331 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-105073312023-09-20 A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation Luo, Yang Wang, Yingwei Zhao, Yongda Guan, Wei Shi, Hanfeng Fu, Chong Jiang, Hongyang Front Oncol Oncology INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, and diagnostic accuracy is also closely related to experts' experience, fatigue and mood and so on. Besides, fully automatic white blood cells segmentation is challenging for several reasons. There exists cell deformation, blurred cell boundaries, and cell color differences, cells overlapping or adhesion. METHODS: The proposed method improves the feature representation capability of the network while reducing parameters and computational redundancy by utilizing the feature reuse of Ghost module to reconstruct a lightweight backbone network. Additionally, a dual-stream feature fusion network (DFFN) based on the feature pyramid network is designed to enhance detailed information acquisition. Furthermore, a dual-domain attention module (DDAM) is developed to extract global features from both frequency and spatial domains simultaneously, resulting in better cell segmentation performance. RESULTS: Experimental results on ALL-IDB and BCCD datasets demonstrate that our method outperforms existing instance segmentation networks such as Mask R-CNN, PointRend, MS R-CNN, SOLOv2, and YOLACT with an average precision (AP) of 87.41%, while significantly reducing parameters and computational cost. DISCUSSION: Our method is significantly better than the current state-of-the-art single-stage methods in terms of both the number of parameters and FLOPs, and our method has the best performance among all compared methods. However, the performance of our method is still lower than the two-stage instance segmentation algorithms. in future work, how to design a more lightweight network model while ensuring a good accuracy will become an important problem. Frontiers Media S.A. 2023-09-04 /pmc/articles/PMC10507331/ /pubmed/37731631 http://dx.doi.org/10.3389/fonc.2023.1223353 Text en Copyright © 2023 Luo, Wang, Zhao, Guan, Shi, Fu and Jiang https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Oncology Luo, Yang Wang, Yingwei Zhao, Yongda Guan, Wei Shi, Hanfeng Fu, Chong Jiang, Hongyang A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title | A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title_full | A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title_fullStr | A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title_full_unstemmed | A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title_short | A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
title_sort | lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation |
topic | Oncology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10507331/ https://www.ncbi.nlm.nih.gov/pubmed/37731631 http://dx.doi.org/10.3389/fonc.2023.1223353 |
work_keys_str_mv | AT luoyang alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT wangyingwei alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT zhaoyongda alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT guanwei alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT shihanfeng alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT fuchong alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT jianghongyang alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT luoyang lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT wangyingwei lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT zhaoyongda lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT guanwei lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT shihanfeng lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT fuchong lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation AT jianghongyang lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation |