Cargando…

In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism

The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjecti...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Yi, Zhu, Yushuang, Liu, Xiongwei, Lu, Yingjian, Liu, Chan, Zhou, Xixin, Fan, Wei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10346521/
https://www.ncbi.nlm.nih.gov/pubmed/37447816
http://dx.doi.org/10.3390/s23135964
_version_ 1785073332071170048
author Zhang, Yi
Zhu, Yushuang
Liu, Xiongwei
Lu, Yingjian
Liu, Chan
Zhou, Xixin
Fan, Wei
author_facet Zhang, Yi
Zhu, Yushuang
Liu, Xiongwei
Lu, Yingjian
Liu, Chan
Zhou, Xixin
Fan, Wei
author_sort Zhang, Yi
collection PubMed
description The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjective interference. Particularly in complex field environments, there is limited research on in situ field maturity recognition of tobacco leaves, making maturity recognition a significant challenge. In response to this problem, this study proposed a MobileNetV1 model combined with a Feature Pyramid Network (FPN) and attention mechanism for in situ field maturity recognition of tobacco leaves. By introducing the FPN structure, the model fully exploits multi-scale features and, in combination with Spatial Attention and SE attention mechanisms, further enhances the expression ability of feature map channel features. The experimental results show that this model, with a size of 13.7 M and FPS of 128.12, performed outstandingly well on the task of field maturity recognition of tobacco leaves, achieving an accuracy of 96.3%, superior to classical models such as VGG16, VGG19, ResNet50, and EfficientNetB0, while maintaining excellent computational efficiency and small memory footprint. Experiments were conducted involving noise perturbations, changes in environmental brightness, and occlusions to validate the model’s robustness in dealing with the complex environments that may be encountered in actual applications. Finally, the Score-CAM algorithm was used for result visualization. Heatmaps showed that the vein and color variations of the leaves provide key feature information for maturity recognition. This indirectly validates the importance of leaf texture and color features in maturity recognition and, to some extent, enhances the credibility of the model. The model proposed in this study maintains high performance while having low storage requirements and computational complexity, making it significant for in situ field maturity recognition of tobacco leaves.
format Online
Article
Text
id pubmed-10346521
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103465212023-07-15 In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism Zhang, Yi Zhu, Yushuang Liu, Xiongwei Lu, Yingjian Liu, Chan Zhou, Xixin Fan, Wei Sensors (Basel) Article The maturity of tobacco leaves plays a decisive role in tobacco production, affecting the quality of the leaves and production control. Traditional recognition of tobacco leaf maturity primarily relies on manual observation and judgment, which is not only inefficient but also susceptible to subjective interference. Particularly in complex field environments, there is limited research on in situ field maturity recognition of tobacco leaves, making maturity recognition a significant challenge. In response to this problem, this study proposed a MobileNetV1 model combined with a Feature Pyramid Network (FPN) and attention mechanism for in situ field maturity recognition of tobacco leaves. By introducing the FPN structure, the model fully exploits multi-scale features and, in combination with Spatial Attention and SE attention mechanisms, further enhances the expression ability of feature map channel features. The experimental results show that this model, with a size of 13.7 M and FPS of 128.12, performed outstandingly well on the task of field maturity recognition of tobacco leaves, achieving an accuracy of 96.3%, superior to classical models such as VGG16, VGG19, ResNet50, and EfficientNetB0, while maintaining excellent computational efficiency and small memory footprint. Experiments were conducted involving noise perturbations, changes in environmental brightness, and occlusions to validate the model’s robustness in dealing with the complex environments that may be encountered in actual applications. Finally, the Score-CAM algorithm was used for result visualization. Heatmaps showed that the vein and color variations of the leaves provide key feature information for maturity recognition. This indirectly validates the importance of leaf texture and color features in maturity recognition and, to some extent, enhances the credibility of the model. The model proposed in this study maintains high performance while having low storage requirements and computational complexity, making it significant for in situ field maturity recognition of tobacco leaves. MDPI 2023-06-27 /pmc/articles/PMC10346521/ /pubmed/37447816 http://dx.doi.org/10.3390/s23135964 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Yi
Zhu, Yushuang
Liu, Xiongwei
Lu, Yingjian
Liu, Chan
Zhou, Xixin
Fan, Wei
In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title_full In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title_fullStr In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title_full_unstemmed In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title_short In-Field Tobacco Leaf Maturity Detection with an Enhanced MobileNetV1: Incorporating a Feature Pyramid Network and Attention Mechanism
title_sort in-field tobacco leaf maturity detection with an enhanced mobilenetv1: incorporating a feature pyramid network and attention mechanism
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10346521/
https://www.ncbi.nlm.nih.gov/pubmed/37447816
http://dx.doi.org/10.3390/s23135964
work_keys_str_mv AT zhangyi infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT zhuyushuang infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT liuxiongwei infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT luyingjian infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT liuchan infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT zhouxixin infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism
AT fanwei infieldtobaccoleafmaturitydetectionwithanenhancedmobilenetv1incorporatingafeaturepyramidnetworkandattentionmechanism