Cargando…

Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block

Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions...

Descripción completa

Detalles Bibliográficos
Autor principal: Montalbo, Francis Jesmar P.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9958064/
https://www.ncbi.nlm.nih.gov/pubmed/36851980
http://dx.doi.org/10.1016/j.mex.2023.102072
_version_ 1784894945913470976
author Montalbo, Francis Jesmar P.
author_facet Montalbo, Francis Jesmar P.
author_sort Montalbo, Francis Jesmar P.
collection PubMed
description Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions against them. However, the existing methods employed to develop a DL model for such a task tend to require massive amounts of computing resources and steps, making them impractical. Based on existing methods, most researchers rely on training pre-trained state-of-the-art (SOTA) deep convolutional neural networks (DCNN), which usually require about a million parameters to train. Hence, this method proposes an approach to craft a model with a far lower computing cost while attaining similar or even significantly better performance than pre-existing models in automating the taxonomy of several mosquitoes. This method combines the approach of layer-wise compression and feature fusion with enhanced residual learning that consists of a self-normalizing activation and depthwise convolutions. • The proposed method yielded a model that outperformed the most recent and classic state-of-the-art deep convolutional neural network models. • With the help of the modified residual block and knowledge distillation, the proposed method significantly reduced a fused model's cost while maintaining competitive performance. • Unlike other methods, the proposed method had the best performance-to-cost ratio.
format Online
Article
Text
id pubmed-9958064
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-99580642023-02-26 Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block Montalbo, Francis Jesmar P. MethodsX Method Article Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions against them. However, the existing methods employed to develop a DL model for such a task tend to require massive amounts of computing resources and steps, making them impractical. Based on existing methods, most researchers rely on training pre-trained state-of-the-art (SOTA) deep convolutional neural networks (DCNN), which usually require about a million parameters to train. Hence, this method proposes an approach to craft a model with a far lower computing cost while attaining similar or even significantly better performance than pre-existing models in automating the taxonomy of several mosquitoes. This method combines the approach of layer-wise compression and feature fusion with enhanced residual learning that consists of a self-normalizing activation and depthwise convolutions. • The proposed method yielded a model that outperformed the most recent and classic state-of-the-art deep convolutional neural network models. • With the help of the modified residual block and knowledge distillation, the proposed method significantly reduced a fused model's cost while maintaining competitive performance. • Unlike other methods, the proposed method had the best performance-to-cost ratio. Elsevier 2023-02-10 /pmc/articles/PMC9958064/ /pubmed/36851980 http://dx.doi.org/10.1016/j.mex.2023.102072 Text en © 2023 The Author(s) https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Method Article
Montalbo, Francis Jesmar P.
Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title_full Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title_fullStr Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title_full_unstemmed Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title_short Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
title_sort automating mosquito taxonomy by compressing and enhancing a feature fused efficientnet with knowledge distillation and a novel residual skip block
topic Method Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9958064/
https://www.ncbi.nlm.nih.gov/pubmed/36851980
http://dx.doi.org/10.1016/j.mex.2023.102072
work_keys_str_mv AT montalbofrancisjesmarp automatingmosquitotaxonomybycompressingandenhancingafeaturefusedefficientnetwithknowledgedistillationandanovelresidualskipblock