Cargando…

Lightweight Fruit-Detection Algorithm for Edge Computing Applications

In recent years, deep-learning-based fruit-detection technology has exhibited excellent performance in modern horticulture research. However, deploying deep learning algorithms in real-time field applications is still challenging, owing to the relatively low image processing capability of edge devic...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Wenli, Liu, Yuxin, Chen, Kaizhen, Li, Huibin, Duan, Yulin, Wu, Wenbin, Shi, Yun, Guo, Wei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548576/
https://www.ncbi.nlm.nih.gov/pubmed/34721466
http://dx.doi.org/10.3389/fpls.2021.740936
_version_ 1784590601782558720
author Zhang, Wenli
Liu, Yuxin
Chen, Kaizhen
Li, Huibin
Duan, Yulin
Wu, Wenbin
Shi, Yun
Guo, Wei
author_facet Zhang, Wenli
Liu, Yuxin
Chen, Kaizhen
Li, Huibin
Duan, Yulin
Wu, Wenbin
Shi, Yun
Guo, Wei
author_sort Zhang, Wenli
collection PubMed
description In recent years, deep-learning-based fruit-detection technology has exhibited excellent performance in modern horticulture research. However, deploying deep learning algorithms in real-time field applications is still challenging, owing to the relatively low image processing capability of edge devices. Such limitations are becoming a new bottleneck and hindering the utilization of AI algorithms in modern horticulture. In this paper, we propose a lightweight fruit-detection algorithm, specifically designed for edge devices. The algorithm is based on Light-CSPNet as the backbone network, an improved feature-extraction module, a down-sampling method, and a feature-fusion module, and it ensures real-time detection on edge devices while maintaining the fruit-detection accuracy. The proposed algorithm was tested on three edge devices: NVIDIA Jetson Xavier NX, NVIDIA Jetson TX2, and NVIDIA Jetson NANO. The experimental results show that the average detection precision of the proposed algorithm for orange, tomato, and apple datasets are 0.93, 0.847, and 0.850, respectively. Deploying the algorithm, the detection speed of NVIDIA Jetson Xavier NX reaches 21.3, 24.8, and 22.2 FPS, while that of NVIDIA Jetson TX2 reaches 13.9, 14.1, and 14.5 FPS and that of NVIDIA Jetson NANO reaches 6.3, 5.0, and 8.5 FPS for the three datasets. Additionally, the proposed algorithm provides a component add/remove function to flexibly adjust the model structure, considering the trade-off between the detection accuracy and speed in practical usage.
format Online
Article
Text
id pubmed-8548576
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-85485762021-10-28 Lightweight Fruit-Detection Algorithm for Edge Computing Applications Zhang, Wenli Liu, Yuxin Chen, Kaizhen Li, Huibin Duan, Yulin Wu, Wenbin Shi, Yun Guo, Wei Front Plant Sci Plant Science In recent years, deep-learning-based fruit-detection technology has exhibited excellent performance in modern horticulture research. However, deploying deep learning algorithms in real-time field applications is still challenging, owing to the relatively low image processing capability of edge devices. Such limitations are becoming a new bottleneck and hindering the utilization of AI algorithms in modern horticulture. In this paper, we propose a lightweight fruit-detection algorithm, specifically designed for edge devices. The algorithm is based on Light-CSPNet as the backbone network, an improved feature-extraction module, a down-sampling method, and a feature-fusion module, and it ensures real-time detection on edge devices while maintaining the fruit-detection accuracy. The proposed algorithm was tested on three edge devices: NVIDIA Jetson Xavier NX, NVIDIA Jetson TX2, and NVIDIA Jetson NANO. The experimental results show that the average detection precision of the proposed algorithm for orange, tomato, and apple datasets are 0.93, 0.847, and 0.850, respectively. Deploying the algorithm, the detection speed of NVIDIA Jetson Xavier NX reaches 21.3, 24.8, and 22.2 FPS, while that of NVIDIA Jetson TX2 reaches 13.9, 14.1, and 14.5 FPS and that of NVIDIA Jetson NANO reaches 6.3, 5.0, and 8.5 FPS for the three datasets. Additionally, the proposed algorithm provides a component add/remove function to flexibly adjust the model structure, considering the trade-off between the detection accuracy and speed in practical usage. Frontiers Media S.A. 2021-10-13 /pmc/articles/PMC8548576/ /pubmed/34721466 http://dx.doi.org/10.3389/fpls.2021.740936 Text en Copyright © 2021 Zhang, Liu, Chen, Li, Duan, Wu, Shi and Guo. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Plant Science
Zhang, Wenli
Liu, Yuxin
Chen, Kaizhen
Li, Huibin
Duan, Yulin
Wu, Wenbin
Shi, Yun
Guo, Wei
Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title_full Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title_fullStr Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title_full_unstemmed Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title_short Lightweight Fruit-Detection Algorithm for Edge Computing Applications
title_sort lightweight fruit-detection algorithm for edge computing applications
topic Plant Science
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548576/
https://www.ncbi.nlm.nih.gov/pubmed/34721466
http://dx.doi.org/10.3389/fpls.2021.740936
work_keys_str_mv AT zhangwenli lightweightfruitdetectionalgorithmforedgecomputingapplications
AT liuyuxin lightweightfruitdetectionalgorithmforedgecomputingapplications
AT chenkaizhen lightweightfruitdetectionalgorithmforedgecomputingapplications
AT lihuibin lightweightfruitdetectionalgorithmforedgecomputingapplications
AT duanyulin lightweightfruitdetectionalgorithmforedgecomputingapplications
AT wuwenbin lightweightfruitdetectionalgorithmforedgecomputingapplications
AT shiyun lightweightfruitdetectionalgorithmforedgecomputingapplications
AT guowei lightweightfruitdetectionalgorithmforedgecomputingapplications