Cargando…

Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification

Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion‐activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of image...

Descripción completa

Detalles Bibliográficos
Autores principales: Egna, Nicole, O'Connor, David, Stacy‐Dawes, Jenna, Tobler, Mathias W., Pilfold, Nicholas, Neilson, Kristin, Simmons, Brooke, Davis, Elizabeth Oneita, Bowler, Mark, Fennessy, Julian, Glikman, Jenny Anne, Larpei, Lexson, Lekalgitele, Jesus, Lekupanai, Ruth, Lekushan, Johnson, Lemingani, Lekuran, Lemirgishan, Joseph, Lenaipa, Daniel, Lenyakopiro, Jonathan, Lesipiti, Ranis Lenalakiti, Lororua, Masenge, Muneza, Arthur, Rabhayo, Sebastian, Ole Ranah, Symon Masiaine, Ruppert, Kirstie, Owen, Megan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7663993/
https://www.ncbi.nlm.nih.gov/pubmed/33209262
http://dx.doi.org/10.1002/ece3.6722
_version_ 1783609755229487104
author Egna, Nicole
O'Connor, David
Stacy‐Dawes, Jenna
Tobler, Mathias W.
Pilfold, Nicholas
Neilson, Kristin
Simmons, Brooke
Davis, Elizabeth Oneita
Bowler, Mark
Fennessy, Julian
Glikman, Jenny Anne
Larpei, Lexson
Lekalgitele, Jesus
Lekupanai, Ruth
Lekushan, Johnson
Lemingani, Lekuran
Lemirgishan, Joseph
Lenaipa, Daniel
Lenyakopiro, Jonathan
Lesipiti, Ranis Lenalakiti
Lororua, Masenge
Muneza, Arthur
Rabhayo, Sebastian
Ole Ranah, Symon Masiaine
Ruppert, Kirstie
Owen, Megan
author_facet Egna, Nicole
O'Connor, David
Stacy‐Dawes, Jenna
Tobler, Mathias W.
Pilfold, Nicholas
Neilson, Kristin
Simmons, Brooke
Davis, Elizabeth Oneita
Bowler, Mark
Fennessy, Julian
Glikman, Jenny Anne
Larpei, Lexson
Lekalgitele, Jesus
Lekupanai, Ruth
Lekushan, Johnson
Lemingani, Lekuran
Lemirgishan, Joseph
Lenaipa, Daniel
Lenyakopiro, Jonathan
Lesipiti, Ranis Lenalakiti
Lororua, Masenge
Muneza, Arthur
Rabhayo, Sebastian
Ole Ranah, Symon Masiaine
Ruppert, Kirstie
Owen, Megan
author_sort Egna, Nicole
collection PubMed
description Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion‐activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best‐practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open‐grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data.
format Online
Article
Text
id pubmed-7663993
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-76639932020-11-17 Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification Egna, Nicole O'Connor, David Stacy‐Dawes, Jenna Tobler, Mathias W. Pilfold, Nicholas Neilson, Kristin Simmons, Brooke Davis, Elizabeth Oneita Bowler, Mark Fennessy, Julian Glikman, Jenny Anne Larpei, Lexson Lekalgitele, Jesus Lekupanai, Ruth Lekushan, Johnson Lemingani, Lekuran Lemirgishan, Joseph Lenaipa, Daniel Lenyakopiro, Jonathan Lesipiti, Ranis Lenalakiti Lororua, Masenge Muneza, Arthur Rabhayo, Sebastian Ole Ranah, Symon Masiaine Ruppert, Kirstie Owen, Megan Ecol Evol Original Research Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion‐activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best‐practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open‐grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data. John Wiley and Sons Inc. 2020-10-06 /pmc/articles/PMC7663993/ /pubmed/33209262 http://dx.doi.org/10.1002/ece3.6722 Text en © 2020 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Research
Egna, Nicole
O'Connor, David
Stacy‐Dawes, Jenna
Tobler, Mathias W.
Pilfold, Nicholas
Neilson, Kristin
Simmons, Brooke
Davis, Elizabeth Oneita
Bowler, Mark
Fennessy, Julian
Glikman, Jenny Anne
Larpei, Lexson
Lekalgitele, Jesus
Lekupanai, Ruth
Lekushan, Johnson
Lemingani, Lekuran
Lemirgishan, Joseph
Lenaipa, Daniel
Lenyakopiro, Jonathan
Lesipiti, Ranis Lenalakiti
Lororua, Masenge
Muneza, Arthur
Rabhayo, Sebastian
Ole Ranah, Symon Masiaine
Ruppert, Kirstie
Owen, Megan
Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title_full Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title_fullStr Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title_full_unstemmed Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title_short Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
title_sort camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7663993/
https://www.ncbi.nlm.nih.gov/pubmed/33209262
http://dx.doi.org/10.1002/ece3.6722
work_keys_str_mv AT egnanicole camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT oconnordavid camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT stacydawesjenna camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT toblermathiasw camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT pilfoldnicholas camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT neilsonkristin camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT simmonsbrooke camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT daviselizabethoneita camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT bowlermark camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT fennessyjulian camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT glikmanjennyanne camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT larpeilexson camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lekalgitelejesus camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lekupanairuth camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lekushanjohnson camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT leminganilekuran camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lemirgishanjoseph camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lenaipadaniel camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lenyakopirojonathan camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lesipitiranislenalakiti camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT lororuamasenge camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT munezaarthur camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT rabhayosebastian camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT oleranahsymonmasiaine camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT ruppertkirstie camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification
AT owenmegan camerasettingsandbiomeinfluencetheaccuracyofcitizenscienceapproachestocameratrapimageclassification