Cargando…
Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting
Manual harvesting of coconuts is a highly risky and skill-demanding operation, and the population of people involved in coconut tree climbing has been steadily decreasing. Hence, with the evolution of tree-climbing robots and robotic end-effectors, the development of autonomous coconut harvesters wi...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9737954/ https://www.ncbi.nlm.nih.gov/pubmed/36496712 http://dx.doi.org/10.3390/foods11233903 |
_version_ | 1784847417621872640 |
---|---|
author | Divyanth, L. G. Soni, Peeyush Pareek, Chaitanya Madhaw Machavaram, Rajendra Nadimi, Mohammad Paliwal, Jitendra |
author_facet | Divyanth, L. G. Soni, Peeyush Pareek, Chaitanya Madhaw Machavaram, Rajendra Nadimi, Mohammad Paliwal, Jitendra |
author_sort | Divyanth, L. G. |
collection | PubMed |
description | Manual harvesting of coconuts is a highly risky and skill-demanding operation, and the population of people involved in coconut tree climbing has been steadily decreasing. Hence, with the evolution of tree-climbing robots and robotic end-effectors, the development of autonomous coconut harvesters with the help of machine vision technologies is of great interest to farmers. However, coconuts are very hard and experience high occlusions on the tree. Hence, accurate detection of coconut clusters based on their occlusion condition is necessary to plan the motion of the robotic end-effector. This study proposes a deep learning-based object detection Faster Regional-Convolutional Neural Network (Faster R-CNN) model to detect coconut clusters as non-occluded and leaf-occluded bunches. To improve identification accuracy, an attention mechanism was introduced into the Faster R-CNN model. The image dataset was acquired from a commercial coconut plantation during daylight under natural lighting conditions using a handheld digital single-lens reflex camera. The proposed model was trained, validated, and tested on 900 manually acquired and augmented images of tree crowns under different illumination conditions, backgrounds, and coconut varieties. On the test dataset, the overall mean average precision (mAP) and weighted mean intersection over union (wmIoU) attained by the model were 0.886 and 0.827, respectively, with average precision for detecting non-occluded and leaf-occluded coconut clusters as 0.912 and 0.883, respectively. The encouraging results provide the base to develop a complete vision system to determine the harvesting strategy and locate the cutting position on the coconut cluster. |
format | Online Article Text |
id | pubmed-9737954 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-97379542022-12-11 Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting Divyanth, L. G. Soni, Peeyush Pareek, Chaitanya Madhaw Machavaram, Rajendra Nadimi, Mohammad Paliwal, Jitendra Foods Article Manual harvesting of coconuts is a highly risky and skill-demanding operation, and the population of people involved in coconut tree climbing has been steadily decreasing. Hence, with the evolution of tree-climbing robots and robotic end-effectors, the development of autonomous coconut harvesters with the help of machine vision technologies is of great interest to farmers. However, coconuts are very hard and experience high occlusions on the tree. Hence, accurate detection of coconut clusters based on their occlusion condition is necessary to plan the motion of the robotic end-effector. This study proposes a deep learning-based object detection Faster Regional-Convolutional Neural Network (Faster R-CNN) model to detect coconut clusters as non-occluded and leaf-occluded bunches. To improve identification accuracy, an attention mechanism was introduced into the Faster R-CNN model. The image dataset was acquired from a commercial coconut plantation during daylight under natural lighting conditions using a handheld digital single-lens reflex camera. The proposed model was trained, validated, and tested on 900 manually acquired and augmented images of tree crowns under different illumination conditions, backgrounds, and coconut varieties. On the test dataset, the overall mean average precision (mAP) and weighted mean intersection over union (wmIoU) attained by the model were 0.886 and 0.827, respectively, with average precision for detecting non-occluded and leaf-occluded coconut clusters as 0.912 and 0.883, respectively. The encouraging results provide the base to develop a complete vision system to determine the harvesting strategy and locate the cutting position on the coconut cluster. MDPI 2022-12-03 /pmc/articles/PMC9737954/ /pubmed/36496712 http://dx.doi.org/10.3390/foods11233903 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Divyanth, L. G. Soni, Peeyush Pareek, Chaitanya Madhaw Machavaram, Rajendra Nadimi, Mohammad Paliwal, Jitendra Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title | Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title_full | Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title_fullStr | Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title_full_unstemmed | Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title_short | Detection of Coconut Clusters Based on Occlusion Condition Using Attention-Guided Faster R-CNN for Robotic Harvesting |
title_sort | detection of coconut clusters based on occlusion condition using attention-guided faster r-cnn for robotic harvesting |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9737954/ https://www.ncbi.nlm.nih.gov/pubmed/36496712 http://dx.doi.org/10.3390/foods11233903 |
work_keys_str_mv | AT divyanthlg detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting AT sonipeeyush detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting AT pareekchaitanyamadhaw detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting AT machavaramrajendra detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting AT nadimimohammad detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting AT paliwaljitendra detectionofcoconutclustersbasedonocclusionconditionusingattentionguidedfasterrcnnforroboticharvesting |