Cargando…

Species‐level image classification with convolutional neural network enables insect identification from habitus images

1. Changes in insect biomass, abundance, and diversity are challenging to track at sufficient spatial, temporal, and taxonomic resolution. Camera traps can capture habitus images of ground‐dwelling insects. However, currently sampling involves manually detecting and identifying specimens. Here, we t...

Descripción completa

Detalles Bibliográficos
Autores principales: Hansen, Oskar L. P., Svenning, Jens‐Christian, Olsen, Kent, Dupont, Steen, Garner, Beulah H., Iosifidis, Alexandros, Price, Benjamin W., Høye, Toke T.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6988528/
https://www.ncbi.nlm.nih.gov/pubmed/32015839
http://dx.doi.org/10.1002/ece3.5921
_version_ 1783492280139644928
author Hansen, Oskar L. P.
Svenning, Jens‐Christian
Olsen, Kent
Dupont, Steen
Garner, Beulah H.
Iosifidis, Alexandros
Price, Benjamin W.
Høye, Toke T.
author_facet Hansen, Oskar L. P.
Svenning, Jens‐Christian
Olsen, Kent
Dupont, Steen
Garner, Beulah H.
Iosifidis, Alexandros
Price, Benjamin W.
Høye, Toke T.
author_sort Hansen, Oskar L. P.
collection PubMed
description 1. Changes in insect biomass, abundance, and diversity are challenging to track at sufficient spatial, temporal, and taxonomic resolution. Camera traps can capture habitus images of ground‐dwelling insects. However, currently sampling involves manually detecting and identifying specimens. Here, we test whether a convolutional neural network (CNN) can classify habitus images of ground beetles to species level, and estimate how correct classification relates to body size, number of species inside genera, and species identity. 2. We created an image database of 65,841 museum specimens comprising 361 carabid beetle species from the British Isles and fine‐tuned the parameters of a pretrained CNN from a training dataset. By summing up class confidence values within genus, tribe, and subfamily and setting a confidence threshold, we trade‐off between classification accuracy, precision, and recall and taxonomic resolution. 3. The CNN classified 51.9% of 19,164 test images correctly to species level and 74.9% to genus level. Average classification recall on species level was 50.7%. Applying a threshold of 0.5 increased the average classification recall to 74.6% at the expense of taxonomic resolution. Higher top value from the output layer and larger sized species were more often classified correctly, as were images of species in genera with few species. 4. Fine‐tuning enabled us to classify images with a high mean recall for the whole test dataset to species or higher taxonomic levels, however, with high variability. This indicates that some species are more difficult to identify because of properties such as their body size or the number of related species. 5. Together, species‐level image classification of arthropods from museum collections and ecological monitoring can substantially increase the amount of occurrence data that can feasibly be collected. These tools thus provide new opportunities in understanding and predicting ecological responses to environmental change.
format Online
Article
Text
id pubmed-6988528
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-69885282020-02-03 Species‐level image classification with convolutional neural network enables insect identification from habitus images Hansen, Oskar L. P. Svenning, Jens‐Christian Olsen, Kent Dupont, Steen Garner, Beulah H. Iosifidis, Alexandros Price, Benjamin W. Høye, Toke T. Ecol Evol Original Research 1. Changes in insect biomass, abundance, and diversity are challenging to track at sufficient spatial, temporal, and taxonomic resolution. Camera traps can capture habitus images of ground‐dwelling insects. However, currently sampling involves manually detecting and identifying specimens. Here, we test whether a convolutional neural network (CNN) can classify habitus images of ground beetles to species level, and estimate how correct classification relates to body size, number of species inside genera, and species identity. 2. We created an image database of 65,841 museum specimens comprising 361 carabid beetle species from the British Isles and fine‐tuned the parameters of a pretrained CNN from a training dataset. By summing up class confidence values within genus, tribe, and subfamily and setting a confidence threshold, we trade‐off between classification accuracy, precision, and recall and taxonomic resolution. 3. The CNN classified 51.9% of 19,164 test images correctly to species level and 74.9% to genus level. Average classification recall on species level was 50.7%. Applying a threshold of 0.5 increased the average classification recall to 74.6% at the expense of taxonomic resolution. Higher top value from the output layer and larger sized species were more often classified correctly, as were images of species in genera with few species. 4. Fine‐tuning enabled us to classify images with a high mean recall for the whole test dataset to species or higher taxonomic levels, however, with high variability. This indicates that some species are more difficult to identify because of properties such as their body size or the number of related species. 5. Together, species‐level image classification of arthropods from museum collections and ecological monitoring can substantially increase the amount of occurrence data that can feasibly be collected. These tools thus provide new opportunities in understanding and predicting ecological responses to environmental change. John Wiley and Sons Inc. 2019-12-24 /pmc/articles/PMC6988528/ /pubmed/32015839 http://dx.doi.org/10.1002/ece3.5921 Text en © 2019 The Authors. Ecology and Evolution published by John Wiley & Sons Ltd. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Research
Hansen, Oskar L. P.
Svenning, Jens‐Christian
Olsen, Kent
Dupont, Steen
Garner, Beulah H.
Iosifidis, Alexandros
Price, Benjamin W.
Høye, Toke T.
Species‐level image classification with convolutional neural network enables insect identification from habitus images
title Species‐level image classification with convolutional neural network enables insect identification from habitus images
title_full Species‐level image classification with convolutional neural network enables insect identification from habitus images
title_fullStr Species‐level image classification with convolutional neural network enables insect identification from habitus images
title_full_unstemmed Species‐level image classification with convolutional neural network enables insect identification from habitus images
title_short Species‐level image classification with convolutional neural network enables insect identification from habitus images
title_sort species‐level image classification with convolutional neural network enables insect identification from habitus images
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6988528/
https://www.ncbi.nlm.nih.gov/pubmed/32015839
http://dx.doi.org/10.1002/ece3.5921
work_keys_str_mv AT hansenoskarlp specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT svenningjenschristian specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT olsenkent specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT dupontsteen specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT garnerbeulahh specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT iosifidisalexandros specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT pricebenjaminw specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages
AT høyetoket specieslevelimageclassificationwithconvolutionalneuralnetworkenablesinsectidentificationfromhabitusimages