Cargando…
DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation
Autonomous harvesters can be used for the timely cultivation of high-value crops such as strawberries, where the robots have the capability to identify ripe and unripe crops. However, the real-time segmentation of strawberries in an unbridled farming environment is a challenging task due to fruit oc...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7937933/ https://www.ncbi.nlm.nih.gov/pubmed/33692814 http://dx.doi.org/10.3389/fpls.2021.591333 |
_version_ | 1783661496282120192 |
---|---|
author | Ilyas, Talha Umraiz, Muhammad Khan, Abbas Kim, Hyongsuk |
author_facet | Ilyas, Talha Umraiz, Muhammad Khan, Abbas Kim, Hyongsuk |
author_sort | Ilyas, Talha |
collection | PubMed |
description | Autonomous harvesters can be used for the timely cultivation of high-value crops such as strawberries, where the robots have the capability to identify ripe and unripe crops. However, the real-time segmentation of strawberries in an unbridled farming environment is a challenging task due to fruit occlusion by multiple trusses, stems, and leaves. In this work, we propose a possible solution by constructing a dynamic feature selection mechanism for convolutional neural networks (CNN). The proposed building block namely a dense attention module (DAM) controls the flow of information between the convolutional encoder and decoder. DAM enables hierarchical adaptive feature fusion by exploiting both inter-channel and intra-channel relationships and can be easily integrated into any existing CNN to obtain category-specific feature maps. We validate our attention module through extensive ablation experiments. In addition, a dataset is collected from different strawberry farms and divided into four classes corresponding to different maturity levels of fruits and one is devoted to background. Quantitative analysis of the proposed method showed a 4.1% and 2.32% increase in mean intersection over union, over existing state-of-the-art semantic segmentation models and other attention modules respectively, while simultaneously retaining a processing speed of 53 frames per second. |
format | Online Article Text |
id | pubmed-7937933 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79379332021-03-09 DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation Ilyas, Talha Umraiz, Muhammad Khan, Abbas Kim, Hyongsuk Front Plant Sci Plant Science Autonomous harvesters can be used for the timely cultivation of high-value crops such as strawberries, where the robots have the capability to identify ripe and unripe crops. However, the real-time segmentation of strawberries in an unbridled farming environment is a challenging task due to fruit occlusion by multiple trusses, stems, and leaves. In this work, we propose a possible solution by constructing a dynamic feature selection mechanism for convolutional neural networks (CNN). The proposed building block namely a dense attention module (DAM) controls the flow of information between the convolutional encoder and decoder. DAM enables hierarchical adaptive feature fusion by exploiting both inter-channel and intra-channel relationships and can be easily integrated into any existing CNN to obtain category-specific feature maps. We validate our attention module through extensive ablation experiments. In addition, a dataset is collected from different strawberry farms and divided into four classes corresponding to different maturity levels of fruits and one is devoted to background. Quantitative analysis of the proposed method showed a 4.1% and 2.32% increase in mean intersection over union, over existing state-of-the-art semantic segmentation models and other attention modules respectively, while simultaneously retaining a processing speed of 53 frames per second. Frontiers Media S.A. 2021-02-22 /pmc/articles/PMC7937933/ /pubmed/33692814 http://dx.doi.org/10.3389/fpls.2021.591333 Text en Copyright © 2021 Ilyas, Umraiz, Khan and Kim. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Plant Science Ilyas, Talha Umraiz, Muhammad Khan, Abbas Kim, Hyongsuk DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title | DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title_full | DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title_fullStr | DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title_full_unstemmed | DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title_short | DAM: Hierarchical Adaptive Feature Selection Using Convolution Encoder Decoder Network for Strawberry Segmentation |
title_sort | dam: hierarchical adaptive feature selection using convolution encoder decoder network for strawberry segmentation |
topic | Plant Science |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7937933/ https://www.ncbi.nlm.nih.gov/pubmed/33692814 http://dx.doi.org/10.3389/fpls.2021.591333 |
work_keys_str_mv | AT ilyastalha damhierarchicaladaptivefeatureselectionusingconvolutionencoderdecodernetworkforstrawberrysegmentation AT umraizmuhammad damhierarchicaladaptivefeatureselectionusingconvolutionencoderdecodernetworkforstrawberrysegmentation AT khanabbas damhierarchicaladaptivefeatureselectionusingconvolutionencoderdecodernetworkforstrawberrysegmentation AT kimhyongsuk damhierarchicaladaptivefeatureselectionusingconvolutionencoderdecodernetworkforstrawberrysegmentation |