Cargando…

Birdsong classification based on ensemble multi-scale convolutional neural network

With the intensification of ecosystem damage, birds have become the symbolic species of the ecosystem. Ornithology with interdisciplinary technical research plays a great significance for protecting birds and evaluating ecosystem quality. Deep learning shows great progress for birdsongs recognition....

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Jiang, Zhang, Yan, Lv, Danjv, Lu, Jing, Xie, Shanshan, Zi, Jiali, Yin, Yue, Xu, Haifeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9126969/
https://www.ncbi.nlm.nih.gov/pubmed/35606386
http://dx.doi.org/10.1038/s41598-022-12121-8
_version_ 1784712247191273472
author Liu, Jiang
Zhang, Yan
Lv, Danjv
Lu, Jing
Xie, Shanshan
Zi, Jiali
Yin, Yue
Xu, Haifeng
author_facet Liu, Jiang
Zhang, Yan
Lv, Danjv
Lu, Jing
Xie, Shanshan
Zi, Jiali
Yin, Yue
Xu, Haifeng
author_sort Liu, Jiang
collection PubMed
description With the intensification of ecosystem damage, birds have become the symbolic species of the ecosystem. Ornithology with interdisciplinary technical research plays a great significance for protecting birds and evaluating ecosystem quality. Deep learning shows great progress for birdsongs recognition. However, as the number of network layers increases in traditional CNN, semantic information gradually becomes richer and detailed information disappears. Secondly, the global information carried by the entire input may be lost in convolution, pooling, or other operations, and these problems will weaken the performance of classification. In order to solve such problems, based on the feature spectrogram from the wavelet transform for the birdsongs, this paper explored the multi-scale convolution neural network (MSCNN) and proposed an ensemble multi-scale convolution neural network (EMSCNN) classification framework. The experiments compared the MSCNN and EMSCNN models with other CNN models including LeNet, VGG16, ResNet101, MobileNetV2, EfficientNetB7, Darknet53 and SPP-net. The results showed that the MSCNN model achieved an accuracy of 89.61%, and EMSCNN achieved an accuracy of 91.49%. In the experiments on the recognition of 30 species of birds, our models effectively improved the classification effect with high stability and efficiency, indicating that the models have better generalization ability and are suitable for birdsongs species recognition. It provides methodological and technical scheme reference for bird classification research.
format Online
Article
Text
id pubmed-9126969
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-91269692022-05-25 Birdsong classification based on ensemble multi-scale convolutional neural network Liu, Jiang Zhang, Yan Lv, Danjv Lu, Jing Xie, Shanshan Zi, Jiali Yin, Yue Xu, Haifeng Sci Rep Article With the intensification of ecosystem damage, birds have become the symbolic species of the ecosystem. Ornithology with interdisciplinary technical research plays a great significance for protecting birds and evaluating ecosystem quality. Deep learning shows great progress for birdsongs recognition. However, as the number of network layers increases in traditional CNN, semantic information gradually becomes richer and detailed information disappears. Secondly, the global information carried by the entire input may be lost in convolution, pooling, or other operations, and these problems will weaken the performance of classification. In order to solve such problems, based on the feature spectrogram from the wavelet transform for the birdsongs, this paper explored the multi-scale convolution neural network (MSCNN) and proposed an ensemble multi-scale convolution neural network (EMSCNN) classification framework. The experiments compared the MSCNN and EMSCNN models with other CNN models including LeNet, VGG16, ResNet101, MobileNetV2, EfficientNetB7, Darknet53 and SPP-net. The results showed that the MSCNN model achieved an accuracy of 89.61%, and EMSCNN achieved an accuracy of 91.49%. In the experiments on the recognition of 30 species of birds, our models effectively improved the classification effect with high stability and efficiency, indicating that the models have better generalization ability and are suitable for birdsongs species recognition. It provides methodological and technical scheme reference for bird classification research. Nature Publishing Group UK 2022-05-23 /pmc/articles/PMC9126969/ /pubmed/35606386 http://dx.doi.org/10.1038/s41598-022-12121-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Liu, Jiang
Zhang, Yan
Lv, Danjv
Lu, Jing
Xie, Shanshan
Zi, Jiali
Yin, Yue
Xu, Haifeng
Birdsong classification based on ensemble multi-scale convolutional neural network
title Birdsong classification based on ensemble multi-scale convolutional neural network
title_full Birdsong classification based on ensemble multi-scale convolutional neural network
title_fullStr Birdsong classification based on ensemble multi-scale convolutional neural network
title_full_unstemmed Birdsong classification based on ensemble multi-scale convolutional neural network
title_short Birdsong classification based on ensemble multi-scale convolutional neural network
title_sort birdsong classification based on ensemble multi-scale convolutional neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9126969/
https://www.ncbi.nlm.nih.gov/pubmed/35606386
http://dx.doi.org/10.1038/s41598-022-12121-8
work_keys_str_mv AT liujiang birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT zhangyan birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT lvdanjv birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT lujing birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT xieshanshan birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT zijiali birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT yinyue birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork
AT xuhaifeng birdsongclassificationbasedonensemblemultiscaleconvolutionalneuralnetwork