Cargando…

Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2

Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images...

Descripción completa

Detalles Bibliográficos
Autores principales: Tabak, Michael A., Norouzzadeh, Mohammad S., Wolfson, David W., Newton, Erica J., Boughton, Raoul K., Ivan, Jacob S., Odell, Eric A., Newkirk, Eric S., Conrey, Reesa Y., Stenglein, Jennifer, Iannarilli, Fabiola, Erb, John, Brook, Ryan K., Davis, Amy J., Lewis, Jesse, Walsh, Daniel P., Beasley, James C., VerCauteren, Kurt C., Clune, Jeff, Miller, Ryan S.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7548173/
https://www.ncbi.nlm.nih.gov/pubmed/33072266
http://dx.doi.org/10.1002/ece3.6692
_version_ 1783592570203406336
author Tabak, Michael A.
Norouzzadeh, Mohammad S.
Wolfson, David W.
Newton, Erica J.
Boughton, Raoul K.
Ivan, Jacob S.
Odell, Eric A.
Newkirk, Eric S.
Conrey, Reesa Y.
Stenglein, Jennifer
Iannarilli, Fabiola
Erb, John
Brook, Ryan K.
Davis, Amy J.
Lewis, Jesse
Walsh, Daniel P.
Beasley, James C.
VerCauteren, Kurt C.
Clune, Jeff
Miller, Ryan S.
author_facet Tabak, Michael A.
Norouzzadeh, Mohammad S.
Wolfson, David W.
Newton, Erica J.
Boughton, Raoul K.
Ivan, Jacob S.
Odell, Eric A.
Newkirk, Eric S.
Conrey, Reesa Y.
Stenglein, Jennifer
Iannarilli, Fabiola
Erb, John
Brook, Ryan K.
Davis, Amy J.
Lewis, Jesse
Walsh, Daniel P.
Beasley, James C.
VerCauteren, Kurt C.
Clune, Jeff
Miller, Ryan S.
author_sort Tabak, Michael A.
collection PubMed
description Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images, or at least filter‐out images that do not contain animals. These approaches are often limited by model transferability, as a model trained to recognize species from one location might not work as well for the same species in different locations. Furthermore, these methods often require advanced computational skills, making them inaccessible to many biologists. We used 3 million camera trap images from 18 studies in 10 states across the United States of America to train two deep neural networks, one that recognizes 58 species, the “species model,” and one that determines if an image is empty or if it contains an animal, the “empty‐animal model.” Our species model and empty‐animal model had accuracies of 96.8% and 97.3%, respectively. Furthermore, the models performed well on some out‐of‐sample datasets, as the species model had 91% accuracy on species from Canada (accuracy range 36%–91% across all out‐of‐sample datasets) and the empty‐animal model achieved an accuracy of 91%–94% on out‐of‐sample datasets from different continents. Our software addresses some of the limitations of using machine learning to classify images from camera traps. By including many species from several locations, our species model is potentially applicable to many camera trap studies in North America. We also found that our empty‐animal model can facilitate removal of images without animals globally. We provide the trained models in an R package (MLWIC2: Machine Learning for Wildlife Image Classification in R), which contains Shiny Applications that allow scientists with minimal programming experience to use trained models and train new models in six neural network architectures with varying depths.
format Online
Article
Text
id pubmed-7548173
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-75481732020-10-16 Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 Tabak, Michael A. Norouzzadeh, Mohammad S. Wolfson, David W. Newton, Erica J. Boughton, Raoul K. Ivan, Jacob S. Odell, Eric A. Newkirk, Eric S. Conrey, Reesa Y. Stenglein, Jennifer Iannarilli, Fabiola Erb, John Brook, Ryan K. Davis, Amy J. Lewis, Jesse Walsh, Daniel P. Beasley, James C. VerCauteren, Kurt C. Clune, Jeff Miller, Ryan S. Ecol Evol Original Research Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images, or at least filter‐out images that do not contain animals. These approaches are often limited by model transferability, as a model trained to recognize species from one location might not work as well for the same species in different locations. Furthermore, these methods often require advanced computational skills, making them inaccessible to many biologists. We used 3 million camera trap images from 18 studies in 10 states across the United States of America to train two deep neural networks, one that recognizes 58 species, the “species model,” and one that determines if an image is empty or if it contains an animal, the “empty‐animal model.” Our species model and empty‐animal model had accuracies of 96.8% and 97.3%, respectively. Furthermore, the models performed well on some out‐of‐sample datasets, as the species model had 91% accuracy on species from Canada (accuracy range 36%–91% across all out‐of‐sample datasets) and the empty‐animal model achieved an accuracy of 91%–94% on out‐of‐sample datasets from different continents. Our software addresses some of the limitations of using machine learning to classify images from camera traps. By including many species from several locations, our species model is potentially applicable to many camera trap studies in North America. We also found that our empty‐animal model can facilitate removal of images without animals globally. We provide the trained models in an R package (MLWIC2: Machine Learning for Wildlife Image Classification in R), which contains Shiny Applications that allow scientists with minimal programming experience to use trained models and train new models in six neural network architectures with varying depths. John Wiley and Sons Inc. 2020-09-16 /pmc/articles/PMC7548173/ /pubmed/33072266 http://dx.doi.org/10.1002/ece3.6692 Text en © 2020 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Research
Tabak, Michael A.
Norouzzadeh, Mohammad S.
Wolfson, David W.
Newton, Erica J.
Boughton, Raoul K.
Ivan, Jacob S.
Odell, Eric A.
Newkirk, Eric S.
Conrey, Reesa Y.
Stenglein, Jennifer
Iannarilli, Fabiola
Erb, John
Brook, Ryan K.
Davis, Amy J.
Lewis, Jesse
Walsh, Daniel P.
Beasley, James C.
VerCauteren, Kurt C.
Clune, Jeff
Miller, Ryan S.
Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title_full Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title_fullStr Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title_full_unstemmed Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title_short Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
title_sort improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: mlwic2
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7548173/
https://www.ncbi.nlm.nih.gov/pubmed/33072266
http://dx.doi.org/10.1002/ece3.6692
work_keys_str_mv AT tabakmichaela improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT norouzzadehmohammads improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT wolfsondavidw improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT newtonericaj improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT boughtonraoulk improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT ivanjacobs improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT odellerica improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT newkirkerics improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT conreyreesay improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT stengleinjennifer improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT iannarillifabiola improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT erbjohn improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT brookryank improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT davisamyj improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT lewisjesse improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT walshdanielp improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT beasleyjamesc improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT vercauterenkurtc improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT clunejeff improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2
AT millerryans improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2