Cargando…
In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjecti...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10346521/ https://www.ncbi.nlm.nih.gov/pubmed/37447816 http://dx.doi.org/10.3390/s23135964 |
_version_ | 1785073332071170048 |
---|---|
author | Zhang, Yi Zhu, Yushuang Liu, Xiongwei Lu, Yingjian Liu, Chan Zhou, Xixin Fan, Wei |
author_facet | Zhang, Yi Zhu, Yushuang Liu, Xiongwei Lu, Yingjian Liu, Chan Zhou, Xixin Fan, Wei |
author_sort | Zhang, Yi |
collection | PubMed |
description | The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjective interference. Particularly in complex field environments, there is limited research on in situ field maturity recognition of tobacco leaves, making maturity recognition a significant challenge. In response to this problem, this study proposed a MobileNetV1 model combined with a Feature Pyramid Network (FPN) and attention mechanism for in situ field maturity recognition of tobacco leaves. By introducing the FPN structure, the model fully exploits multi-scale features and, in combination with Spatial Attention and SE attention mechanisms, further enhances the expression ability of feature map channel features. The experimental results show that this model, with a size of 13.7 M and FPS of 128.12, performed outstandingly well on the task of field maturity recognition of tobacco leaves, achieving an accuracy of 96.3%, superior to classical models such as VGG16, VGG19, ResNet50, and EfficientNetB0, while maintaining excellent computational efficiency and small memory footprint. Experiments were conducted involving noise perturbations, changes in environmental brightness, and occlusions to validate the model’s robustness in dealing with the complex environments that may be encountered in actual applications. Finally, the Score-CAM algorithm was used for result visualization. Heatmaps showed that the vein and color variations of the leaves provide key feature information for maturity recognition. This indirectly validates the importance of leaf texture and color features in maturity recognition and, to some extent, enhances the credibility of the model. The model proposed in this study maintains high performance while having low storage requirements and computational complexity, making it significant for in situ field maturity recognition of tobacco leaves. |
format | Online Article Text |
id | pubmed-10346521 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-103465212023-07-15 In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism Zhang, Yi Zhu, Yushuang Liu, Xiongwei Lu, Yingjian Liu, Chan Zhou, Xixin Fan, Wei Sensors (Basel) Article The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjective interference. Particularly in complex field environments, there is limited research on in situ field maturity recognition of tobacco leaves, making maturity recognition a significant challenge. In response to this problem, this study proposed a MobileNetV1 model combined with a Feature Pyramid Network (FPN) and attention mechanism for in situ field maturity recognition of tobacco leaves. By introducing the FPN structure, the model fully exploits multi-scale features and, in combination with Spatial Attention and SE attention mechanisms, further enhances the expression ability of feature map channel features. The experimental results show that this model, with a size of 13.7 M and FPS of 128.12, performed outstandingly well on the task of field maturity recognition of tobacco leaves, achieving an accuracy of 96.3%, superior to classical models such as VGG16, VGG19, ResNet50, and EfficientNetB0, while maintaining excellent computational efficiency and small memory footprint. Experiments were conducted involving noise perturbations, changes in environmental brightness, and occlusions to validate the model’s robustness in dealing with the complex environments that may be encountered in actual applications. Finally, the Score-CAM algorithm was used for result visualization. Heatmaps showed that the vein and color variations of the leaves provide key feature information for maturity recognition. This indirectly validates the importance of leaf texture and color features in maturity recognition and, to some extent, enhances the credibility of the model. The model proposed in this study maintains high performance while having low storage requirements and computational complexity, making it significant for in situ field maturity recognition of tobacco leaves. MDPI 2023-06-27 /pmc/articles/PMC10346521/ /pubmed/37447816 http://dx.doi.org/10.3390/s23135964 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Yi Zhu, Yushuang Liu, Xiongwei Lu, Yingjian Liu, Chan Zhou, Xixin Fan, Wei In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title | In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title_full | In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title_fullStr | In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title_full_unstemmed | In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title_short | In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism |
title_sort | in-field tobacco leaf maturity detection with an enhanced mobilenetv1: incorporating a feature pyramid network and attention mechanism |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10346521/ https://www.ncbi.nlm.nih.gov/pubmed/37447816 http://dx.doi.org/10.3390/s23135964 |
work_keys_str_mv | AT zhangyi infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT zhuyushuang infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT liuxiongwei infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT luyingjian infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT liuchan infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT zhouxixin infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism AT fanwei infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism |