Cargando…

A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation

INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, an...

Descripción completa

Detalles Bibliográficos
Autores principales: Luo, Yang, Wang, Yingwei, Zhao, Yongda, Guan, Wei, Shi, Hanfeng, Fu, Chong, Jiang, Hongyang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10507331/
https://www.ncbi.nlm.nih.gov/pubmed/37731631
http://dx.doi.org/10.3389/fonc.2023.1223353
_version_ 1785107292958490624
author Luo, Yang
Wang, Yingwei
Zhao, Yongda
Guan, Wei
Shi, Hanfeng
Fu, Chong
Jiang, Hongyang
author_facet Luo, Yang
Wang, Yingwei
Zhao, Yongda
Guan, Wei
Shi, Hanfeng
Fu, Chong
Jiang, Hongyang
author_sort Luo, Yang
collection PubMed
description INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, and diagnostic accuracy is also closely related to experts' experience, fatigue and mood and so on. Besides, fully automatic white blood cells segmentation is challenging for several reasons. There exists cell deformation, blurred cell boundaries, and cell color differences, cells overlapping or adhesion. METHODS: The proposed method improves the feature representation capability of the network while reducing parameters and computational redundancy by utilizing the feature reuse of Ghost module to reconstruct a lightweight backbone network. Additionally, a dual-stream feature fusion network (DFFN) based on the feature pyramid network is designed to enhance detailed information acquisition. Furthermore, a dual-domain attention module (DDAM) is developed to extract global features from both frequency and spatial domains simultaneously, resulting in better cell segmentation performance. RESULTS: Experimental results on ALL-IDB and BCCD datasets demonstrate that our method outperforms existing instance segmentation networks such as Mask R-CNN, PointRend, MS R-CNN, SOLOv2, and YOLACT with an average precision (AP) of 87.41%, while significantly reducing parameters and computational cost. DISCUSSION: Our method is significantly better than the current state-of-the-art single-stage methods in terms of both the number of parameters and FLOPs, and our method has the best performance among all compared methods. However, the performance of our method is still lower than the two-stage instance segmentation algorithms. in future work, how to design a more lightweight network model while ensuring a good accuracy will become an important problem.
format Online
Article
Text
id pubmed-10507331
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-105073312023-09-20 A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation Luo, Yang Wang, Yingwei Zhao, Yongda Guan, Wei Shi, Hanfeng Fu, Chong Jiang, Hongyang Front Oncol Oncology INTRODUCTION: Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, and diagnostic accuracy is also closely related to experts' experience, fatigue and mood and so on. Besides, fully automatic white blood cells segmentation is challenging for several reasons. There exists cell deformation, blurred cell boundaries, and cell color differences, cells overlapping or adhesion. METHODS: The proposed method improves the feature representation capability of the network while reducing parameters and computational redundancy by utilizing the feature reuse of Ghost module to reconstruct a lightweight backbone network. Additionally, a dual-stream feature fusion network (DFFN) based on the feature pyramid network is designed to enhance detailed information acquisition. Furthermore, a dual-domain attention module (DDAM) is developed to extract global features from both frequency and spatial domains simultaneously, resulting in better cell segmentation performance. RESULTS: Experimental results on ALL-IDB and BCCD datasets demonstrate that our method outperforms existing instance segmentation networks such as Mask R-CNN, PointRend, MS R-CNN, SOLOv2, and YOLACT with an average precision (AP) of 87.41%, while significantly reducing parameters and computational cost. DISCUSSION: Our method is significantly better than the current state-of-the-art single-stage methods in terms of both the number of parameters and FLOPs, and our method has the best performance among all compared methods. However, the performance of our method is still lower than the two-stage instance segmentation algorithms. in future work, how to design a more lightweight network model while ensuring a good accuracy will become an important problem. Frontiers Media S.A. 2023-09-04 /pmc/articles/PMC10507331/ /pubmed/37731631 http://dx.doi.org/10.3389/fonc.2023.1223353 Text en Copyright © 2023 Luo, Wang, Zhao, Guan, Shi, Fu and Jiang https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Oncology
Luo, Yang
Wang, Yingwei
Zhao, Yongda
Guan, Wei
Shi, Hanfeng
Fu, Chong
Jiang, Hongyang
A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title_full A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title_fullStr A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title_full_unstemmed A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title_short A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
title_sort lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation
topic Oncology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10507331/
https://www.ncbi.nlm.nih.gov/pubmed/37731631
http://dx.doi.org/10.3389/fonc.2023.1223353
work_keys_str_mv AT luoyang alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT wangyingwei alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT zhaoyongda alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT guanwei alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT shihanfeng alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT fuchong alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT jianghongyang alightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT luoyang lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT wangyingwei lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT zhaoyongda lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT guanwei lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT shihanfeng lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT fuchong lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation
AT jianghongyang lightweightnetworkbasedondualstreamfeaturefusionanddualdomainattentionforwhitebloodcellssegmentation