Cargando…
3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this descript...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6411112/ https://www.ncbi.nlm.nih.gov/pubmed/30856198 http://dx.doi.org/10.1371/journal.pone.0211899 |
_version_ | 1783402340778246144 |
---|---|
author | Cuevas-Rodríguez, María Picinali, Lorenzo González-Toledo, Daniel Garre, Carlos de la Rubia-Cuestas, Ernesto Molina-Tanco, Luis Reyes-Lecuona, Arcadio |
author_facet | Cuevas-Rodríguez, María Picinali, Lorenzo González-Toledo, Daniel Garre, Carlos de la Rubia-Cuestas, Ernesto Molina-Tanco, Luis Reyes-Lecuona, Arcadio |
author_sort | Cuevas-Rodríguez, María |
collection | PubMed |
description | The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic signal path by convolving sound sources with Head Related Impulse Responses (HRIRs), obtained by interpolating those extracted from a set that can be loaded from any file in a standard audio format. Interaural time differences are managed separately, in order to be able to customise the rendering according the head size of the listener, and to reduce comb-filtering when interpolating between different HRIRs. In addition, geometrical and frequency-dependent corrections for simulating near-field sources are included. Reverberation is computed separately using a virtual loudspeakers Ambisonic approach and convolution with Binaural Room Impulse Responses (BRIRs). In all these processes, special care has been put in avoiding audible artefacts produced by changes in gains and audio filters due to the movements of sources and of the listener. The 3DTI Toolkit performance, as well as some other relevant metrics such as non-linear distortion, are assessed and presented, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers. |
format | Online Article Text |
id | pubmed-6411112 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-64111122019-04-01 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation Cuevas-Rodríguez, María Picinali, Lorenzo González-Toledo, Daniel Garre, Carlos de la Rubia-Cuestas, Ernesto Molina-Tanco, Luis Reyes-Lecuona, Arcadio PLoS One Research Article The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic signal path by convolving sound sources with Head Related Impulse Responses (HRIRs), obtained by interpolating those extracted from a set that can be loaded from any file in a standard audio format. Interaural time differences are managed separately, in order to be able to customise the rendering according the head size of the listener, and to reduce comb-filtering when interpolating between different HRIRs. In addition, geometrical and frequency-dependent corrections for simulating near-field sources are included. Reverberation is computed separately using a virtual loudspeakers Ambisonic approach and convolution with Binaural Room Impulse Responses (BRIRs). In all these processes, special care has been put in avoiding audible artefacts produced by changes in gains and audio filters due to the movements of sources and of the listener. The 3DTI Toolkit performance, as well as some other relevant metrics such as non-linear distortion, are assessed and presented, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers. Public Library of Science 2019-03-11 /pmc/articles/PMC6411112/ /pubmed/30856198 http://dx.doi.org/10.1371/journal.pone.0211899 Text en © 2019 Cuevas-Rodríguez et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Cuevas-Rodríguez, María Picinali, Lorenzo González-Toledo, Daniel Garre, Carlos de la Rubia-Cuestas, Ernesto Molina-Tanco, Luis Reyes-Lecuona, Arcadio 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title | 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title_full | 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title_fullStr | 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title_full_unstemmed | 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title_short | 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation |
title_sort | 3d tune-in toolkit: an open-source library for real-time binaural spatialisation |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6411112/ https://www.ncbi.nlm.nih.gov/pubmed/30856198 http://dx.doi.org/10.1371/journal.pone.0211899 |
work_keys_str_mv | AT cuevasrodriguezmaria 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT picinalilorenzo 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT gonzaleztoledodaniel 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT garrecarlos 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT delarubiacuestasernesto 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT molinatancoluis 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation AT reyeslecuonaarcadio 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation |