Cargando…
An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network
SIMPLE SUMMARY: Automatic bird sound recognition using artificial intelligence technology has been widely used to identify bird species recently. However, the bird sounds recorded in the wild are usually mixed sounds, which can affect the accuracy of identification. In this paper, we utilized massiv...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9686777/ https://www.ncbi.nlm.nih.gov/pubmed/36428345 http://dx.doi.org/10.3390/ani12223117 |
_version_ | 1784835837581590528 |
---|---|
author | Zhang, Chengyun Chen, Yonghuan Hao, Zezhou Gao, Xinghui |
author_facet | Zhang, Chengyun Chen, Yonghuan Hao, Zezhou Gao, Xinghui |
author_sort | Zhang, Chengyun |
collection | PubMed |
description | SIMPLE SUMMARY: Automatic bird sound recognition using artificial intelligence technology has been widely used to identify bird species recently. However, the bird sounds recorded in the wild are usually mixed sounds, which can affect the accuracy of identification. In this paper, we utilized massive amounts of data of bird sounds and proposed an efficient time-domain single-channel bird sound separation network. Our proposed network achieved good separation performance and fast separation speed while greatly reducing the consumption of computational resources. Our work may help to discriminate individual birds and study the interaction between individual birds, as well as to realize the automatic identification of bird species in various mobile and edge computing devices. ABSTRACT: Bird sounds have obvious characteristics per species, and they are an important way for birds to communicate and transmit information. However, the recorded bird sounds in the field are usually mixed, which making it challenging to identify different bird species and to perform associated tasks. In this study, based on the supervised learning framework, we propose a bird sound separation network, a dual-path tiny transformer network, to directly perform end-to-end mixed species bird sound separation in the time-domain. This separation network is mainly composed of the dual-path network and the simplified transformer structure, which greatly reduces the computational resources required of the network. Experimental results show that our proposed separation network has good separation performance (SI-SNRi reaches 19.3 dB and SDRi reaches 20.1 dB), but compared with DPRNN and DPTNet, its parameters and floating point operations are greatly reduced, which means a higher separation efficiency and faster separation speed. The good separation performance and high separation efficiency indicate that our proposed separation network is valuable for distinguishing individual birds and studying the interaction between individual birds, as well as for realizing the automatic identification of bird species on a variety of mobile devices or edge computing devices. |
format | Online Article Text |
id | pubmed-9686777 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-96867772022-11-25 An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network Zhang, Chengyun Chen, Yonghuan Hao, Zezhou Gao, Xinghui Animals (Basel) Article SIMPLE SUMMARY: Automatic bird sound recognition using artificial intelligence technology has been widely used to identify bird species recently. However, the bird sounds recorded in the wild are usually mixed sounds, which can affect the accuracy of identification. In this paper, we utilized massive amounts of data of bird sounds and proposed an efficient time-domain single-channel bird sound separation network. Our proposed network achieved good separation performance and fast separation speed while greatly reducing the consumption of computational resources. Our work may help to discriminate individual birds and study the interaction between individual birds, as well as to realize the automatic identification of bird species in various mobile and edge computing devices. ABSTRACT: Bird sounds have obvious characteristics per species, and they are an important way for birds to communicate and transmit information. However, the recorded bird sounds in the field are usually mixed, which making it challenging to identify different bird species and to perform associated tasks. In this study, based on the supervised learning framework, we propose a bird sound separation network, a dual-path tiny transformer network, to directly perform end-to-end mixed species bird sound separation in the time-domain. This separation network is mainly composed of the dual-path network and the simplified transformer structure, which greatly reduces the computational resources required of the network. Experimental results show that our proposed separation network has good separation performance (SI-SNRi reaches 19.3 dB and SDRi reaches 20.1 dB), but compared with DPRNN and DPTNet, its parameters and floating point operations are greatly reduced, which means a higher separation efficiency and faster separation speed. The good separation performance and high separation efficiency indicate that our proposed separation network is valuable for distinguishing individual birds and studying the interaction between individual birds, as well as for realizing the automatic identification of bird species on a variety of mobile devices or edge computing devices. MDPI 2022-11-11 /pmc/articles/PMC9686777/ /pubmed/36428345 http://dx.doi.org/10.3390/ani12223117 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Chengyun Chen, Yonghuan Hao, Zezhou Gao, Xinghui An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title | An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title_full | An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title_fullStr | An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title_full_unstemmed | An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title_short | An Efficient Time-Domain End-to-End Single-Channel Bird Sound Separation Network |
title_sort | efficient time-domain end-to-end single-channel bird sound separation network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9686777/ https://www.ncbi.nlm.nih.gov/pubmed/36428345 http://dx.doi.org/10.3390/ani12223117 |
work_keys_str_mv | AT zhangchengyun anefficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT chenyonghuan anefficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT haozezhou anefficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT gaoxinghui anefficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT zhangchengyun efficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT chenyonghuan efficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT haozezhou efficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork AT gaoxinghui efficienttimedomainendtoendsinglechannelbirdsoundseparationnetwork |