Cargando…

Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method

It is important to obtain accurate information about kiwifruit vines to monitoring their physiological states and undertake precise orchard operations. However, because vines are small and cling to trellises, and have branches laying on the ground, numerous challenges exist in the acquisition of acc...

Descripción completa

Detalles Bibliográficos
Autores principales: Niu, Zijie, Deng, Juntao, Zhang, Xu, Zhang, Jun, Pan, Shijia, Mu, Haotian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8271489/
https://www.ncbi.nlm.nih.gov/pubmed/34209571
http://dx.doi.org/10.3390/s21134442
_version_ 1783721014293692416
author Niu, Zijie
Deng, Juntao
Zhang, Xu
Zhang, Jun
Pan, Shijia
Mu, Haotian
author_facet Niu, Zijie
Deng, Juntao
Zhang, Xu
Zhang, Jun
Pan, Shijia
Mu, Haotian
author_sort Niu, Zijie
collection PubMed
description It is important to obtain accurate information about kiwifruit vines to monitoring their physiological states and undertake precise orchard operations. However, because vines are small and cling to trellises, and have branches laying on the ground, numerous challenges exist in the acquisition of accurate data for kiwifruit vines. In this paper, a kiwifruit canopy distribution prediction model is proposed on the basis of low-altitude unmanned aerial vehicle (UAV) images and deep learning techniques. First, the location of the kiwifruit plants and vine distribution are extracted from high-precision images collected by UAV. The canopy gradient distribution maps with different noise reduction and distribution effects are generated by modifying the threshold and sampling size using the resampling normalization method. The results showed that the accuracies of the vine segmentation using PSPnet, support vector machine, and random forest classification were 71.2%, 85.8%, and 75.26%, respectively. However, the segmentation image obtained using depth semantic segmentation had a higher signal-to-noise ratio and was closer to the real situation. The average intersection over union of the deep semantic segmentation was more than or equal to 80% in distribution maps, whereas, in traditional machine learning, the average intersection was between 20% and 60%. This indicates the proposed model can quickly extract the vine distribution and plant position, and is thus able to perform dynamic monitoring of orchards to provide real-time operation guidance.
format Online
Article
Text
id pubmed-8271489
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-82714892021-07-11 Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method Niu, Zijie Deng, Juntao Zhang, Xu Zhang, Jun Pan, Shijia Mu, Haotian Sensors (Basel) Article It is important to obtain accurate information about kiwifruit vines to monitoring their physiological states and undertake precise orchard operations. However, because vines are small and cling to trellises, and have branches laying on the ground, numerous challenges exist in the acquisition of accurate data for kiwifruit vines. In this paper, a kiwifruit canopy distribution prediction model is proposed on the basis of low-altitude unmanned aerial vehicle (UAV) images and deep learning techniques. First, the location of the kiwifruit plants and vine distribution are extracted from high-precision images collected by UAV. The canopy gradient distribution maps with different noise reduction and distribution effects are generated by modifying the threshold and sampling size using the resampling normalization method. The results showed that the accuracies of the vine segmentation using PSPnet, support vector machine, and random forest classification were 71.2%, 85.8%, and 75.26%, respectively. However, the segmentation image obtained using depth semantic segmentation had a higher signal-to-noise ratio and was closer to the real situation. The average intersection over union of the deep semantic segmentation was more than or equal to 80% in distribution maps, whereas, in traditional machine learning, the average intersection was between 20% and 60%. This indicates the proposed model can quickly extract the vine distribution and plant position, and is thus able to perform dynamic monitoring of orchards to provide real-time operation guidance. MDPI 2021-06-29 /pmc/articles/PMC8271489/ /pubmed/34209571 http://dx.doi.org/10.3390/s21134442 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Niu, Zijie
Deng, Juntao
Zhang, Xu
Zhang, Jun
Pan, Shijia
Mu, Haotian
Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title_full Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title_fullStr Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title_full_unstemmed Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title_short Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method
title_sort identifying the branch of kiwifruit based on unmanned aerial vehicle (uav) images using deep learning method
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8271489/
https://www.ncbi.nlm.nih.gov/pubmed/34209571
http://dx.doi.org/10.3390/s21134442
work_keys_str_mv AT niuzijie identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod
AT dengjuntao identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod
AT zhangxu identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod
AT zhangjun identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod
AT panshijia identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod
AT muhaotian identifyingthebranchofkiwifruitbasedonunmannedaerialvehicleuavimagesusingdeeplearningmethod