Cargando…

Rhythm perception is shared between audio and haptics

A surface texture is perceived through both the sound and vibrations produced while being explored by our fingers. Because of their common origin, both modalities have a strong influence on each other, particularly at above 60 Hz for which vibrotactile perception and pitch perception share common ne...

Descripción completa

Detalles Bibliográficos
Autores principales: Bernard, Corentin, Monnoyer, Jocelyn, Wiertlewski, Michaël, Ystad, Sølvi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8907191/
https://www.ncbi.nlm.nih.gov/pubmed/35264703
http://dx.doi.org/10.1038/s41598-022-08152-w
_version_ 1784665582677786624
author Bernard, Corentin
Monnoyer, Jocelyn
Wiertlewski, Michaël
Ystad, Sølvi
author_facet Bernard, Corentin
Monnoyer, Jocelyn
Wiertlewski, Michaël
Ystad, Sølvi
author_sort Bernard, Corentin
collection PubMed
description A surface texture is perceived through both the sound and vibrations produced while being explored by our fingers. Because of their common origin, both modalities have a strong influence on each other, particularly at above 60 Hz for which vibrotactile perception and pitch perception share common neural processes. However, whether the sensation of rhythm is shared between audio and haptic perception is still an open question. In this study, we show striking similarities between the audio and haptic perception of rhythmic changes, and demonstrate the interaction of both modalities below 60 Hz. Using a new surface-haptic device to synthesize arbitrary audio-haptic textures, psychophysical experiments demonstrate that the perception threshold curves of audio and haptic rhythmic gradients are the same. Moreover, multimodal integration occurs when audio and haptic rhythmic gradients are congruent. We propose a multimodal model of rhythm perception to explain these observations. These findings suggest that audio and haptic signals are likely to be processed by common neural mechanisms also for the perception of rhythm. They provide a framework for audio-haptic stimulus generation that is beneficial for nonverbal communication or modern human-machine interfaces.
format Online
Article
Text
id pubmed-8907191
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-89071912022-03-10 Rhythm perception is shared between audio and haptics Bernard, Corentin Monnoyer, Jocelyn Wiertlewski, Michaël Ystad, Sølvi Sci Rep Article A surface texture is perceived through both the sound and vibrations produced while being explored by our fingers. Because of their common origin, both modalities have a strong influence on each other, particularly at above 60 Hz for which vibrotactile perception and pitch perception share common neural processes. However, whether the sensation of rhythm is shared between audio and haptic perception is still an open question. In this study, we show striking similarities between the audio and haptic perception of rhythmic changes, and demonstrate the interaction of both modalities below 60 Hz. Using a new surface-haptic device to synthesize arbitrary audio-haptic textures, psychophysical experiments demonstrate that the perception threshold curves of audio and haptic rhythmic gradients are the same. Moreover, multimodal integration occurs when audio and haptic rhythmic gradients are congruent. We propose a multimodal model of rhythm perception to explain these observations. These findings suggest that audio and haptic signals are likely to be processed by common neural mechanisms also for the perception of rhythm. They provide a framework for audio-haptic stimulus generation that is beneficial for nonverbal communication or modern human-machine interfaces. Nature Publishing Group UK 2022-03-09 /pmc/articles/PMC8907191/ /pubmed/35264703 http://dx.doi.org/10.1038/s41598-022-08152-w Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Bernard, Corentin
Monnoyer, Jocelyn
Wiertlewski, Michaël
Ystad, Sølvi
Rhythm perception is shared between audio and haptics
title Rhythm perception is shared between audio and haptics
title_full Rhythm perception is shared between audio and haptics
title_fullStr Rhythm perception is shared between audio and haptics
title_full_unstemmed Rhythm perception is shared between audio and haptics
title_short Rhythm perception is shared between audio and haptics
title_sort rhythm perception is shared between audio and haptics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8907191/
https://www.ncbi.nlm.nih.gov/pubmed/35264703
http://dx.doi.org/10.1038/s41598-022-08152-w
work_keys_str_mv AT bernardcorentin rhythmperceptionissharedbetweenaudioandhaptics
AT monnoyerjocelyn rhythmperceptionissharedbetweenaudioandhaptics
AT wiertlewskimichael rhythmperceptionissharedbetweenaudioandhaptics
AT ystadsølvi rhythmperceptionissharedbetweenaudioandhaptics