Cargando…
Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2
Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images...
Autores principales: | , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7548173/ https://www.ncbi.nlm.nih.gov/pubmed/33072266 http://dx.doi.org/10.1002/ece3.6692 |
_version_ | 1783592570203406336 |
---|---|
author | Tabak, Michael A. Norouzzadeh, Mohammad S. Wolfson, David W. Newton, Erica J. Boughton, Raoul K. Ivan, Jacob S. Odell, Eric A. Newkirk, Eric S. Conrey, Reesa Y. Stenglein, Jennifer Iannarilli, Fabiola Erb, John Brook, Ryan K. Davis, Amy J. Lewis, Jesse Walsh, Daniel P. Beasley, James C. VerCauteren, Kurt C. Clune, Jeff Miller, Ryan S. |
author_facet | Tabak, Michael A. Norouzzadeh, Mohammad S. Wolfson, David W. Newton, Erica J. Boughton, Raoul K. Ivan, Jacob S. Odell, Eric A. Newkirk, Eric S. Conrey, Reesa Y. Stenglein, Jennifer Iannarilli, Fabiola Erb, John Brook, Ryan K. Davis, Amy J. Lewis, Jesse Walsh, Daniel P. Beasley, James C. VerCauteren, Kurt C. Clune, Jeff Miller, Ryan S. |
author_sort | Tabak, Michael A. |
collection | PubMed |
description | Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images, or at least filter‐out images that do not contain animals. These approaches are often limited by model transferability, as a model trained to recognize species from one location might not work as well for the same species in different locations. Furthermore, these methods often require advanced computational skills, making them inaccessible to many biologists. We used 3 million camera trap images from 18 studies in 10 states across the United States of America to train two deep neural networks, one that recognizes 58 species, the “species model,” and one that determines if an image is empty or if it contains an animal, the “empty‐animal model.” Our species model and empty‐animal model had accuracies of 96.8% and 97.3%, respectively. Furthermore, the models performed well on some out‐of‐sample datasets, as the species model had 91% accuracy on species from Canada (accuracy range 36%–91% across all out‐of‐sample datasets) and the empty‐animal model achieved an accuracy of 91%–94% on out‐of‐sample datasets from different continents. Our software addresses some of the limitations of using machine learning to classify images from camera traps. By including many species from several locations, our species model is potentially applicable to many camera trap studies in North America. We also found that our empty‐animal model can facilitate removal of images without animals globally. We provide the trained models in an R package (MLWIC2: Machine Learning for Wildlife Image Classification in R), which contains Shiny Applications that allow scientists with minimal programming experience to use trained models and train new models in six neural network architectures with varying depths. |
format | Online Article Text |
id | pubmed-7548173 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-75481732020-10-16 Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 Tabak, Michael A. Norouzzadeh, Mohammad S. Wolfson, David W. Newton, Erica J. Boughton, Raoul K. Ivan, Jacob S. Odell, Eric A. Newkirk, Eric S. Conrey, Reesa Y. Stenglein, Jennifer Iannarilli, Fabiola Erb, John Brook, Ryan K. Davis, Amy J. Lewis, Jesse Walsh, Daniel P. Beasley, James C. VerCauteren, Kurt C. Clune, Jeff Miller, Ryan S. Ecol Evol Original Research Motion‐activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images, or at least filter‐out images that do not contain animals. These approaches are often limited by model transferability, as a model trained to recognize species from one location might not work as well for the same species in different locations. Furthermore, these methods often require advanced computational skills, making them inaccessible to many biologists. We used 3 million camera trap images from 18 studies in 10 states across the United States of America to train two deep neural networks, one that recognizes 58 species, the “species model,” and one that determines if an image is empty or if it contains an animal, the “empty‐animal model.” Our species model and empty‐animal model had accuracies of 96.8% and 97.3%, respectively. Furthermore, the models performed well on some out‐of‐sample datasets, as the species model had 91% accuracy on species from Canada (accuracy range 36%–91% across all out‐of‐sample datasets) and the empty‐animal model achieved an accuracy of 91%–94% on out‐of‐sample datasets from different continents. Our software addresses some of the limitations of using machine learning to classify images from camera traps. By including many species from several locations, our species model is potentially applicable to many camera trap studies in North America. We also found that our empty‐animal model can facilitate removal of images without animals globally. We provide the trained models in an R package (MLWIC2: Machine Learning for Wildlife Image Classification in R), which contains Shiny Applications that allow scientists with minimal programming experience to use trained models and train new models in six neural network architectures with varying depths. John Wiley and Sons Inc. 2020-09-16 /pmc/articles/PMC7548173/ /pubmed/33072266 http://dx.doi.org/10.1002/ece3.6692 Text en © 2020 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Original Research Tabak, Michael A. Norouzzadeh, Mohammad S. Wolfson, David W. Newton, Erica J. Boughton, Raoul K. Ivan, Jacob S. Odell, Eric A. Newkirk, Eric S. Conrey, Reesa Y. Stenglein, Jennifer Iannarilli, Fabiola Erb, John Brook, Ryan K. Davis, Amy J. Lewis, Jesse Walsh, Daniel P. Beasley, James C. VerCauteren, Kurt C. Clune, Jeff Miller, Ryan S. Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title | Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title_full | Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title_fullStr | Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title_full_unstemmed | Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title_short | Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2 |
title_sort | improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: mlwic2 |
topic | Original Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7548173/ https://www.ncbi.nlm.nih.gov/pubmed/33072266 http://dx.doi.org/10.1002/ece3.6692 |
work_keys_str_mv | AT tabakmichaela improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT norouzzadehmohammads improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT wolfsondavidw improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT newtonericaj improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT boughtonraoulk improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT ivanjacobs improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT odellerica improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT newkirkerics improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT conreyreesay improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT stengleinjennifer improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT iannarillifabiola improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT erbjohn improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT brookryank improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT davisamyj improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT lewisjesse improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT walshdanielp improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT beasleyjamesc improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT vercauterenkurtc improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT clunejeff improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 AT millerryans improvingtheaccessibilityandtransferabilityofmachinelearningalgorithmsforidentificationofanimalsincameratrapimagesmlwic2 |