Cargando…

Adaptive representations of sound for automatic insect recognition

Insect population numbers and biodiversity have been rapidly declining with time, and monitoring these trends has become increasingly important for conservation measures to be effectively implemented. But monitoring methods are often invasive, time and resource intense, and prone to various biases....

Descripción completa

Detalles Bibliográficos
Autores principales: Faiß, Marius, Stowell, Dan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10578591/
https://www.ncbi.nlm.nih.gov/pubmed/37792895
http://dx.doi.org/10.1371/journal.pcbi.1011541
_version_ 1785121549736476672
author Faiß, Marius
Stowell, Dan
author_facet Faiß, Marius
Stowell, Dan
author_sort Faiß, Marius
collection PubMed
description Insect population numbers and biodiversity have been rapidly declining with time, and monitoring these trends has become increasingly important for conservation measures to be effectively implemented. But monitoring methods are often invasive, time and resource intense, and prone to various biases. Many insect species produce characteristic sounds that can easily be detected and recorded without large cost or effort. Using deep learning methods, insect sounds from field recordings could be automatically detected and classified to monitor biodiversity and species distribution ranges. We implement this using recently published datasets of insect sounds (up to 66 species of Orthoptera and Cicadidae) and machine learning methods and evaluate their potential for acoustic insect monitoring. We compare the performance of the conventional spectrogram-based audio representation against LEAF, a new adaptive and waveform-based frontend. LEAF achieved better classification performance than the mel-spectrogram frontend by adapting its feature extraction parameters during training. This result is encouraging for future implementations of deep learning technology for automatic insect sound recognition, especially as larger datasets become available.
format Online
Article
Text
id pubmed-10578591
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-105785912023-10-17 Adaptive representations of sound for automatic insect recognition Faiß, Marius Stowell, Dan PLoS Comput Biol Research Article Insect population numbers and biodiversity have been rapidly declining with time, and monitoring these trends has become increasingly important for conservation measures to be effectively implemented. But monitoring methods are often invasive, time and resource intense, and prone to various biases. Many insect species produce characteristic sounds that can easily be detected and recorded without large cost or effort. Using deep learning methods, insect sounds from field recordings could be automatically detected and classified to monitor biodiversity and species distribution ranges. We implement this using recently published datasets of insect sounds (up to 66 species of Orthoptera and Cicadidae) and machine learning methods and evaluate their potential for acoustic insect monitoring. We compare the performance of the conventional spectrogram-based audio representation against LEAF, a new adaptive and waveform-based frontend. LEAF achieved better classification performance than the mel-spectrogram frontend by adapting its feature extraction parameters during training. This result is encouraging for future implementations of deep learning technology for automatic insect sound recognition, especially as larger datasets become available. Public Library of Science 2023-10-04 /pmc/articles/PMC10578591/ /pubmed/37792895 http://dx.doi.org/10.1371/journal.pcbi.1011541 Text en © 2023 Faiß, Stowell https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Faiß, Marius
Stowell, Dan
Adaptive representations of sound for automatic insect recognition
title Adaptive representations of sound for automatic insect recognition
title_full Adaptive representations of sound for automatic insect recognition
title_fullStr Adaptive representations of sound for automatic insect recognition
title_full_unstemmed Adaptive representations of sound for automatic insect recognition
title_short Adaptive representations of sound for automatic insect recognition
title_sort adaptive representations of sound for automatic insect recognition
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10578591/
https://www.ncbi.nlm.nih.gov/pubmed/37792895
http://dx.doi.org/10.1371/journal.pcbi.1011541
work_keys_str_mv AT faißmarius adaptiverepresentationsofsoundforautomaticinsectrecognition
AT stowelldan adaptiverepresentationsofsoundforautomaticinsectrecognition