Cargando…
Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention
Maize leaf diseases significantly reduce maize yield; therefore, monitoring and identifying the diseases during the growing season are crucial. Some of the current studies are based on images with simple backgrounds, and the realistic field settings are full of background noise, making this task cha...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9096888/ https://www.ncbi.nlm.nih.gov/pubmed/35574079 http://dx.doi.org/10.3389/fpls.2022.864486 |
_version_ | 1784706071508549632 |
---|---|
author | Qian, Xiufeng Zhang, Chengqi Chen, Li Li, Ke |
author_facet | Qian, Xiufeng Zhang, Chengqi Chen, Li Li, Ke |
author_sort | Qian, Xiufeng |
collection | PubMed |
description | Maize leaf diseases significantly reduce maize yield; therefore, monitoring and identifying the diseases during the growing season are crucial. Some of the current studies are based on images with simple backgrounds, and the realistic field settings are full of background noise, making this task challenging. We collected low-cost red, green, and blue (RGB) images from our experimental fields and public dataset, and they contain a total of four categories, namely, southern corn leaf blight (SCLB), gray leaf spot (GLS), southern corn rust (SR), and healthy (H). This article proposes a model different from convolutional neural networks (CNNs) based on transformer and self-attention. It represents visual information of local regions of images by tokens, calculates the correlation (called attention) of information between local regions with an attention mechanism, and finally integrates global information to make the classification. The results show that our model achieves the best performance compared to five mainstream CNNs at a meager computational cost, and the attention mechanism plays an extremely important role. The disease lesions information was effectively emphasized, and the background noise was suppressed. The proposed model is more suitable for fine-grained maize leaf disease identification in a complex background, and we demonstrated this idea from three perspectives, namely, theoretical, experimental, and visualization. |
format | Online Article Text |
id | pubmed-9096888 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90968882022-05-13 Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention Qian, Xiufeng Zhang, Chengqi Chen, Li Li, Ke Front Plant Sci Plant Science Maize leaf diseases significantly reduce maize yield; therefore, monitoring and identifying the diseases during the growing season are crucial. Some of the current studies are based on images with simple backgrounds, and the realistic field settings are full of background noise, making this task challenging. We collected low-cost red, green, and blue (RGB) images from our experimental fields and public dataset, and they contain a total of four categories, namely, southern corn leaf blight (SCLB), gray leaf spot (GLS), southern corn rust (SR), and healthy (H). This article proposes a model different from convolutional neural networks (CNNs) based on transformer and self-attention. It represents visual information of local regions of images by tokens, calculates the correlation (called attention) of information between local regions with an attention mechanism, and finally integrates global information to make the classification. The results show that our model achieves the best performance compared to five mainstream CNNs at a meager computational cost, and the attention mechanism plays an extremely important role. The disease lesions information was effectively emphasized, and the background noise was suppressed. The proposed model is more suitable for fine-grained maize leaf disease identification in a complex background, and we demonstrated this idea from three perspectives, namely, theoretical, experimental, and visualization. Frontiers Media S.A. 2022-04-28 /pmc/articles/PMC9096888/ /pubmed/35574079 http://dx.doi.org/10.3389/fpls.2022.864486 Text en Copyright © 2022 Qian, Zhang, Chen and Li. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Plant Science Qian, Xiufeng Zhang, Chengqi Chen, Li Li, Ke Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title | Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title_full | Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title_fullStr | Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title_full_unstemmed | Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title_short | Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention |
title_sort | deep learning-based identification of maize leaf diseases is improved by an attention mechanism: self-attention |
topic | Plant Science |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9096888/ https://www.ncbi.nlm.nih.gov/pubmed/35574079 http://dx.doi.org/10.3389/fpls.2022.864486 |
work_keys_str_mv | AT qianxiufeng deeplearningbasedidentificationofmaizeleafdiseasesisimprovedbyanattentionmechanismselfattention AT zhangchengqi deeplearningbasedidentificationofmaizeleafdiseasesisimprovedbyanattentionmechanismselfattention AT chenli deeplearningbasedidentificationofmaizeleafdiseasesisimprovedbyanattentionmechanismselfattention AT like deeplearningbasedidentificationofmaizeleafdiseasesisimprovedbyanattentionmechanismselfattention |