Cargando…
Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block
Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9958064/ https://www.ncbi.nlm.nih.gov/pubmed/36851980 http://dx.doi.org/10.1016/j.mex.2023.102072 |
_version_ | 1784894945913470976 |
---|---|
author | Montalbo, Francis Jesmar P. |
author_facet | Montalbo, Francis Jesmar P. |
author_sort | Montalbo, Francis Jesmar P. |
collection | PubMed |
description | Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions against them. However, the existing methods employed to develop a DL model for such a task tend to require massive amounts of computing resources and steps, making them impractical. Based on existing methods, most researchers rely on training pre-trained state-of-the-art (SOTA) deep convolutional neural networks (DCNN), which usually require about a million parameters to train. Hence, this method proposes an approach to craft a model with a far lower computing cost while attaining similar or even significantly better performance than pre-existing models in automating the taxonomy of several mosquitoes. This method combines the approach of layer-wise compression and feature fusion with enhanced residual learning that consists of a self-normalizing activation and depthwise convolutions. • The proposed method yielded a model that outperformed the most recent and classic state-of-the-art deep convolutional neural network models. • With the help of the modified residual block and knowledge distillation, the proposed method significantly reduced a fused model's cost while maintaining competitive performance. • Unlike other methods, the proposed method had the best performance-to-cost ratio. |
format | Online Article Text |
id | pubmed-9958064 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-99580642023-02-26 Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block Montalbo, Francis Jesmar P. MethodsX Method Article Identifying lethal vector and non-vector mosquitoes can become difficult for a layperson and sometimes even for experts, considering their visual similarities. Recently, deep learning (DL) became a solution to assist in differentiating the two mosquito types to reduce infections and enhance actions against them. However, the existing methods employed to develop a DL model for such a task tend to require massive amounts of computing resources and steps, making them impractical. Based on existing methods, most researchers rely on training pre-trained state-of-the-art (SOTA) deep convolutional neural networks (DCNN), which usually require about a million parameters to train. Hence, this method proposes an approach to craft a model with a far lower computing cost while attaining similar or even significantly better performance than pre-existing models in automating the taxonomy of several mosquitoes. This method combines the approach of layer-wise compression and feature fusion with enhanced residual learning that consists of a self-normalizing activation and depthwise convolutions. • The proposed method yielded a model that outperformed the most recent and classic state-of-the-art deep convolutional neural network models. • With the help of the modified residual block and knowledge distillation, the proposed method significantly reduced a fused model's cost while maintaining competitive performance. • Unlike other methods, the proposed method had the best performance-to-cost ratio. Elsevier 2023-02-10 /pmc/articles/PMC9958064/ /pubmed/36851980 http://dx.doi.org/10.1016/j.mex.2023.102072 Text en © 2023 The Author(s) https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Method Article Montalbo, Francis Jesmar P. Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title | Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title_full | Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title_fullStr | Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title_full_unstemmed | Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title_short | Automating mosquito taxonomy by compressing and enhancing a feature fused EfficientNet with knowledge distillation and a novel residual skip block |
title_sort | automating mosquito taxonomy by compressing and enhancing a feature fused efficientnet with knowledge distillation and a novel residual skip block |
topic | Method Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9958064/ https://www.ncbi.nlm.nih.gov/pubmed/36851980 http://dx.doi.org/10.1016/j.mex.2023.102072 |
work_keys_str_mv | AT montalbofrancisjesmarp automatingmosquitotaxonomybycompressingandenhancingafeaturefusedefficientnetwithknowledgedistillationandanovelresidualskipblock |