Cargando…

Flower Mapping in Grasslands With Drones and Deep Learning

Manual assessment of flower abundance of different flowering plant species in grasslands is a time-consuming process. We present an automated approach to determine the flower abundance in grasslands from drone-based aerial images by using deep learning (Faster R-CNN) object detection approach, which...

Descripción completa

Detalles Bibliográficos
Autores principales: Gallmann, Johannes, Schüpbach, Beatrice, Jacot, Katja, Albrecht, Matthias, Winizki, Jonas, Kirchgessner, Norbert, Aasen, Helge
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8864122/
https://www.ncbi.nlm.nih.gov/pubmed/35222449
http://dx.doi.org/10.3389/fpls.2021.774965
_version_ 1784655385416695808
author Gallmann, Johannes
Schüpbach, Beatrice
Jacot, Katja
Albrecht, Matthias
Winizki, Jonas
Kirchgessner, Norbert
Aasen, Helge
author_facet Gallmann, Johannes
Schüpbach, Beatrice
Jacot, Katja
Albrecht, Matthias
Winizki, Jonas
Kirchgessner, Norbert
Aasen, Helge
author_sort Gallmann, Johannes
collection PubMed
description Manual assessment of flower abundance of different flowering plant species in grasslands is a time-consuming process. We present an automated approach to determine the flower abundance in grasslands from drone-based aerial images by using deep learning (Faster R-CNN) object detection approach, which was trained and evaluated on data from five flights at two sites. Our deep learning network was able to identify and classify individual flowers. The novel method allowed generating spatially explicit maps of flower abundance that met or exceeded the accuracy of the manual-count-data extrapolation method while being less labor intensive. The results were very good for some types of flowers, with precision and recall being close to or higher than 90%. Other flowers were detected poorly due to reasons such as lack of enough training data, appearance changes due to phenology, or flowers being too small to be reliably distinguishable on the aerial images. The method was able to give precise estimates of the abundance of many flowering plant species. In the future, the collection of more training data will allow better predictions for the flowers that are not well predicted yet. The developed pipeline can be applied to any sort of aerial object detection problem.
format Online
Article
Text
id pubmed-8864122
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-88641222022-02-24 Flower Mapping in Grasslands With Drones and Deep Learning Gallmann, Johannes Schüpbach, Beatrice Jacot, Katja Albrecht, Matthias Winizki, Jonas Kirchgessner, Norbert Aasen, Helge Front Plant Sci Plant Science Manual assessment of flower abundance of different flowering plant species in grasslands is a time-consuming process. We present an automated approach to determine the flower abundance in grasslands from drone-based aerial images by using deep learning (Faster R-CNN) object detection approach, which was trained and evaluated on data from five flights at two sites. Our deep learning network was able to identify and classify individual flowers. The novel method allowed generating spatially explicit maps of flower abundance that met or exceeded the accuracy of the manual-count-data extrapolation method while being less labor intensive. The results were very good for some types of flowers, with precision and recall being close to or higher than 90%. Other flowers were detected poorly due to reasons such as lack of enough training data, appearance changes due to phenology, or flowers being too small to be reliably distinguishable on the aerial images. The method was able to give precise estimates of the abundance of many flowering plant species. In the future, the collection of more training data will allow better predictions for the flowers that are not well predicted yet. The developed pipeline can be applied to any sort of aerial object detection problem. Frontiers Media S.A. 2022-02-09 /pmc/articles/PMC8864122/ /pubmed/35222449 http://dx.doi.org/10.3389/fpls.2021.774965 Text en Copyright © 2022 Gallmann, Schüpbach, Jacot, Albrecht, Winizki, Kirchgessner and Aasen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Plant Science
Gallmann, Johannes
Schüpbach, Beatrice
Jacot, Katja
Albrecht, Matthias
Winizki, Jonas
Kirchgessner, Norbert
Aasen, Helge
Flower Mapping in Grasslands With Drones and Deep Learning
title Flower Mapping in Grasslands With Drones and Deep Learning
title_full Flower Mapping in Grasslands With Drones and Deep Learning
title_fullStr Flower Mapping in Grasslands With Drones and Deep Learning
title_full_unstemmed Flower Mapping in Grasslands With Drones and Deep Learning
title_short Flower Mapping in Grasslands With Drones and Deep Learning
title_sort flower mapping in grasslands with drones and deep learning
topic Plant Science
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8864122/
https://www.ncbi.nlm.nih.gov/pubmed/35222449
http://dx.doi.org/10.3389/fpls.2021.774965
work_keys_str_mv AT gallmannjohannes flowermappingingrasslandswithdronesanddeeplearning
AT schupbachbeatrice flowermappingingrasslandswithdronesanddeeplearning
AT jacotkatja flowermappingingrasslandswithdronesanddeeplearning
AT albrechtmatthias flowermappingingrasslandswithdronesanddeeplearning
AT winizkijonas flowermappingingrasslandswithdronesanddeeplearning
AT kirchgessnernorbert flowermappingingrasslandswithdronesanddeeplearning
AT aasenhelge flowermappingingrasslandswithdronesanddeeplearning