Cargando…

3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation

The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this descript...

Descripción completa

Detalles Bibliográficos
Autores principales: Cuevas-Rodríguez, María, Picinali, Lorenzo, González-Toledo, Daniel, Garre, Carlos, de la Rubia-Cuestas, Ernesto, Molina-Tanco, Luis, Reyes-Lecuona, Arcadio
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6411112/
https://www.ncbi.nlm.nih.gov/pubmed/30856198
http://dx.doi.org/10.1371/journal.pone.0211899
_version_ 1783402340778246144
author Cuevas-Rodríguez, María
Picinali, Lorenzo
González-Toledo, Daniel
Garre, Carlos
de la Rubia-Cuestas, Ernesto
Molina-Tanco, Luis
Reyes-Lecuona, Arcadio
author_facet Cuevas-Rodríguez, María
Picinali, Lorenzo
González-Toledo, Daniel
Garre, Carlos
de la Rubia-Cuestas, Ernesto
Molina-Tanco, Luis
Reyes-Lecuona, Arcadio
author_sort Cuevas-Rodríguez, María
collection PubMed
description The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic signal path by convolving sound sources with Head Related Impulse Responses (HRIRs), obtained by interpolating those extracted from a set that can be loaded from any file in a standard audio format. Interaural time differences are managed separately, in order to be able to customise the rendering according the head size of the listener, and to reduce comb-filtering when interpolating between different HRIRs. In addition, geometrical and frequency-dependent corrections for simulating near-field sources are included. Reverberation is computed separately using a virtual loudspeakers Ambisonic approach and convolution with Binaural Room Impulse Responses (BRIRs). In all these processes, special care has been put in avoiding audible artefacts produced by changes in gains and audio filters due to the movements of sources and of the listener. The 3DTI Toolkit performance, as well as some other relevant metrics such as non-linear distortion, are assessed and presented, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers.
format Online
Article
Text
id pubmed-6411112
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-64111122019-04-01 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation Cuevas-Rodríguez, María Picinali, Lorenzo González-Toledo, Daniel Garre, Carlos de la Rubia-Cuestas, Ernesto Molina-Tanco, Luis Reyes-Lecuona, Arcadio PLoS One Research Article The 3D Tune-In Toolkit (3DTI Toolkit) is an open-source standard C++ library which includes a binaural spatialiser. This paper presents the technical details of this renderer, outlining its architecture and describing the processes implemented in each of its components. In order to put this description into context, the basic concepts behind binaural spatialisation are reviewed through a chronology of research milestones in the field in the last 40 years. The 3DTI Toolkit renders the anechoic signal path by convolving sound sources with Head Related Impulse Responses (HRIRs), obtained by interpolating those extracted from a set that can be loaded from any file in a standard audio format. Interaural time differences are managed separately, in order to be able to customise the rendering according the head size of the listener, and to reduce comb-filtering when interpolating between different HRIRs. In addition, geometrical and frequency-dependent corrections for simulating near-field sources are included. Reverberation is computed separately using a virtual loudspeakers Ambisonic approach and convolution with Binaural Room Impulse Responses (BRIRs). In all these processes, special care has been put in avoiding audible artefacts produced by changes in gains and audio filters due to the movements of sources and of the listener. The 3DTI Toolkit performance, as well as some other relevant metrics such as non-linear distortion, are assessed and presented, followed by a comparison between the features offered by the 3DTI Toolkit and those found in other currently available open- and closed-source binaural renderers. Public Library of Science 2019-03-11 /pmc/articles/PMC6411112/ /pubmed/30856198 http://dx.doi.org/10.1371/journal.pone.0211899 Text en © 2019 Cuevas-Rodríguez et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Cuevas-Rodríguez, María
Picinali, Lorenzo
González-Toledo, Daniel
Garre, Carlos
de la Rubia-Cuestas, Ernesto
Molina-Tanco, Luis
Reyes-Lecuona, Arcadio
3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title_full 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title_fullStr 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title_full_unstemmed 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title_short 3D Tune-In Toolkit: An open-source library for real-time binaural spatialisation
title_sort 3d tune-in toolkit: an open-source library for real-time binaural spatialisation
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6411112/
https://www.ncbi.nlm.nih.gov/pubmed/30856198
http://dx.doi.org/10.1371/journal.pone.0211899
work_keys_str_mv AT cuevasrodriguezmaria 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT picinalilorenzo 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT gonzaleztoledodaniel 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT garrecarlos 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT delarubiacuestasernesto 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT molinatancoluis 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation
AT reyeslecuonaarcadio 3dtuneintoolkitanopensourcelibraryforrealtimebinauralspatialisation