Cargando…

A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network

The accurate detection of green citrus in natural environments is a key step in realizing the intelligent harvesting of citrus through robotics. At present, the visual detection algorithms for green citrus in natural environments still have poor accuracy and robustness due to the color similarity be...

Descripción completa

Detalles Bibliográficos
Autores principales: Zheng, Zhenhui, Xiong, Juntao, Lin, Huan, Han, Yonglin, Sun, Baoxia, Xie, Zhiming, Yang, Zhengang, Wang, Chenglin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8453023/
https://www.ncbi.nlm.nih.gov/pubmed/34557214
http://dx.doi.org/10.3389/fpls.2021.705737
_version_ 1784570206505402368
author Zheng, Zhenhui
Xiong, Juntao
Lin, Huan
Han, Yonglin
Sun, Baoxia
Xie, Zhiming
Yang, Zhengang
Wang, Chenglin
author_facet Zheng, Zhenhui
Xiong, Juntao
Lin, Huan
Han, Yonglin
Sun, Baoxia
Xie, Zhiming
Yang, Zhengang
Wang, Chenglin
author_sort Zheng, Zhenhui
collection PubMed
description The accurate detection of green citrus in natural environments is a key step in realizing the intelligent harvesting of citrus through robotics. At present, the visual detection algorithms for green citrus in natural environments still have poor accuracy and robustness due to the color similarity between fruits and backgrounds. This study proposed a multi-scale convolutional neural network (CNN) named YOLO BP to detect green citrus in natural environments. Firstly, the backbone network, CSPDarknet53, was trimmed to extract high-quality features and improve the real-time performance of the network. Then, by removing the redundant nodes of the Path Aggregation Network (PANet) and adding additional connections, a bi-directional feature pyramid network (Bi-PANet) was proposed to efficiently fuse the multilayer features. Finally, three groups of green citrus detection experiments were designed to evaluate the network performance. The results showed that the accuracy, recall, mean average precision (mAP), and detection speed of YOLO BP were 86, 91, and 91.55% and 18 frames per second (FPS), respectively, which were 2, 7, and 4.3% and 1 FPS higher than those of YOLO v4. The proposed detection algorithm had strong robustness and high accuracy in the complex orchard environment, which provides technical support for green fruit detection in natural environments.
format Online
Article
Text
id pubmed-8453023
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-84530232021-09-22 A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network Zheng, Zhenhui Xiong, Juntao Lin, Huan Han, Yonglin Sun, Baoxia Xie, Zhiming Yang, Zhengang Wang, Chenglin Front Plant Sci Plant Science The accurate detection of green citrus in natural environments is a key step in realizing the intelligent harvesting of citrus through robotics. At present, the visual detection algorithms for green citrus in natural environments still have poor accuracy and robustness due to the color similarity between fruits and backgrounds. This study proposed a multi-scale convolutional neural network (CNN) named YOLO BP to detect green citrus in natural environments. Firstly, the backbone network, CSPDarknet53, was trimmed to extract high-quality features and improve the real-time performance of the network. Then, by removing the redundant nodes of the Path Aggregation Network (PANet) and adding additional connections, a bi-directional feature pyramid network (Bi-PANet) was proposed to efficiently fuse the multilayer features. Finally, three groups of green citrus detection experiments were designed to evaluate the network performance. The results showed that the accuracy, recall, mean average precision (mAP), and detection speed of YOLO BP were 86, 91, and 91.55% and 18 frames per second (FPS), respectively, which were 2, 7, and 4.3% and 1 FPS higher than those of YOLO v4. The proposed detection algorithm had strong robustness and high accuracy in the complex orchard environment, which provides technical support for green fruit detection in natural environments. Frontiers Media S.A. 2021-09-07 /pmc/articles/PMC8453023/ /pubmed/34557214 http://dx.doi.org/10.3389/fpls.2021.705737 Text en Copyright © 2021 Zheng, Xiong, Lin, Han, Sun, Xie, Yang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Plant Science
Zheng, Zhenhui
Xiong, Juntao
Lin, Huan
Han, Yonglin
Sun, Baoxia
Xie, Zhiming
Yang, Zhengang
Wang, Chenglin
A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title_full A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title_fullStr A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title_full_unstemmed A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title_short A Method of Green Citrus Detection in Natural Environments Using a Deep Convolutional Neural Network
title_sort method of green citrus detection in natural environments using a deep convolutional neural network
topic Plant Science
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8453023/
https://www.ncbi.nlm.nih.gov/pubmed/34557214
http://dx.doi.org/10.3389/fpls.2021.705737
work_keys_str_mv AT zhengzhenhui amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT xiongjuntao amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT linhuan amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT hanyonglin amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT sunbaoxia amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT xiezhiming amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT yangzhengang amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT wangchenglin amethodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT zhengzhenhui methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT xiongjuntao methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT linhuan methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT hanyonglin methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT sunbaoxia methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT xiezhiming methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT yangzhengang methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork
AT wangchenglin methodofgreencitrusdetectioninnaturalenvironmentsusingadeepconvolutionalneuralnetwork