Cargando…

Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch

Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to giv...

Descripción completa

Detalles Bibliográficos
Autores principales: Remache-Vinueza, Byron, Trujillo-León, Andrés, Zapata, Mireya, Sarmiento-Ortiz, Fabián, Vidal-Verdú, Fernando
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513049/
https://www.ncbi.nlm.nih.gov/pubmed/34640895
http://dx.doi.org/10.3390/s21196575
_version_ 1784583140221648896
author Remache-Vinueza, Byron
Trujillo-León, Andrés
Zapata, Mireya
Sarmiento-Ortiz, Fabián
Vidal-Verdú, Fernando
author_facet Remache-Vinueza, Byron
Trujillo-León, Andrés
Zapata, Mireya
Sarmiento-Ortiz, Fabián
Vidal-Verdú, Fernando
author_sort Remache-Vinueza, Byron
collection PubMed
description Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to give the opportunity of experiencing music through touch to the hearing impaired. These devices may also be conceived as vibrotactile music players to enrich music listening activities. In this review, technology and methods to render musical information by means of vibrotactile stimuli are systematically studied. The methodology used to find out relevant literature is first outlined, and a preliminary classification of musical haptics is proposed. A comparison between different technologies and methods for vibrotactile rendering is performed to later organize the information according to the type of HMP. Limitations and advantages are highlighted to find out opportunities for future research. Likewise, methods for music audio-tactile rendering (ATR) are analyzed and, finally, strategies to compose for the sense of touch are summarized. This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR.
format Online
Article
Text
id pubmed-8513049
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-85130492021-10-14 Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch Remache-Vinueza, Byron Trujillo-León, Andrés Zapata, Mireya Sarmiento-Ortiz, Fabián Vidal-Verdú, Fernando Sensors (Basel) Review Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to give the opportunity of experiencing music through touch to the hearing impaired. These devices may also be conceived as vibrotactile music players to enrich music listening activities. In this review, technology and methods to render musical information by means of vibrotactile stimuli are systematically studied. The methodology used to find out relevant literature is first outlined, and a preliminary classification of musical haptics is proposed. A comparison between different technologies and methods for vibrotactile rendering is performed to later organize the information according to the type of HMP. Limitations and advantages are highlighted to find out opportunities for future research. Likewise, methods for music audio-tactile rendering (ATR) are analyzed and, finally, strategies to compose for the sense of touch are summarized. This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR. MDPI 2021-09-30 /pmc/articles/PMC8513049/ /pubmed/34640895 http://dx.doi.org/10.3390/s21196575 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Remache-Vinueza, Byron
Trujillo-León, Andrés
Zapata, Mireya
Sarmiento-Ortiz, Fabián
Vidal-Verdú, Fernando
Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title_full Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title_fullStr Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title_full_unstemmed Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title_short Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch
title_sort audio-tactile rendering: a review on technology and methods to convey musical information through the sense of touch
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513049/
https://www.ncbi.nlm.nih.gov/pubmed/34640895
http://dx.doi.org/10.3390/s21196575
work_keys_str_mv AT remachevinuezabyron audiotactilerenderingareviewontechnologyandmethodstoconveymusicalinformationthroughthesenseoftouch
AT trujilloleonandres audiotactilerenderingareviewontechnologyandmethodstoconveymusicalinformationthroughthesenseoftouch
AT zapatamireya audiotactilerenderingareviewontechnologyandmethodstoconveymusicalinformationthroughthesenseoftouch
AT sarmientoortizfabian audiotactilerenderingareviewontechnologyandmethodstoconveymusicalinformationthroughthesenseoftouch
AT vidalverdufernando audiotactilerenderingareviewontechnologyandmethodstoconveymusicalinformationthroughthesenseoftouch