Cargando…

Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category

People occasionally associate color (e.g., hue) with sound (e.g., pitch). Previous studies have reported color–sound associations, which are examples of crossmodal correspondences. However, the association between both semantic and perceptual factors with color/sound discrimination in crossmodal cor...

Descripción completa

Detalles Bibliográficos
Autores principales: Miyamoto, Kenta, Taniyama, Yuma, Hine, Kyoko, Nakauchi, Shigeki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10467208/
https://www.ncbi.nlm.nih.gov/pubmed/37654696
http://dx.doi.org/10.1177/20416695231196835
_version_ 1785099064703975424
author Miyamoto, Kenta
Taniyama, Yuma
Hine, Kyoko
Nakauchi, Shigeki
author_facet Miyamoto, Kenta
Taniyama, Yuma
Hine, Kyoko
Nakauchi, Shigeki
author_sort Miyamoto, Kenta
collection PubMed
description People occasionally associate color (e.g., hue) with sound (e.g., pitch). Previous studies have reported color–sound associations, which are examples of crossmodal correspondences. However, the association between both semantic and perceptual factors with color/sound discrimination in crossmodal correspondence remains unclear. To clarify this, three psychological experiments were conducted, where Stroop tasks were used to assess automatic process on the association. We focused on the crossmodal correspondence between color (Experiment 1)/color word (Experiment 2) and sound. Participants discriminated the color/word or the sound presented simultaneously. The results showed the color–sound bidirectional enhancement/interference of the response by certain associations of the crossmodal correspondence (blue-drop and yellow-shiny) in both experiments. These results suggest that these Stroop effects were caused by the semantic factor (color category) and the perceptual factor (color appearance) was not necessary for the current results. In Experiment 3, response modulation by color labeling was investigated to clarify the influence of subjective labeling. Participants labeled a presented ambiguous color, which was a hue specification between two specific colors, by listening to the sound. The results revealed that the Stroop effect was caused only when the presented color was classified as the color related to the presented sound. This showed that subjective labeling played a role in the regulation of the effect of crossmodal correspondences. These findings should contribute to the explanation of crossmodal correspondences through semantic mediation.
format Online
Article
Text
id pubmed-10467208
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-104672082023-08-31 Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category Miyamoto, Kenta Taniyama, Yuma Hine, Kyoko Nakauchi, Shigeki Iperception Standard Article People occasionally associate color (e.g., hue) with sound (e.g., pitch). Previous studies have reported color–sound associations, which are examples of crossmodal correspondences. However, the association between both semantic and perceptual factors with color/sound discrimination in crossmodal correspondence remains unclear. To clarify this, three psychological experiments were conducted, where Stroop tasks were used to assess automatic process on the association. We focused on the crossmodal correspondence between color (Experiment 1)/color word (Experiment 2) and sound. Participants discriminated the color/word or the sound presented simultaneously. The results showed the color–sound bidirectional enhancement/interference of the response by certain associations of the crossmodal correspondence (blue-drop and yellow-shiny) in both experiments. These results suggest that these Stroop effects were caused by the semantic factor (color category) and the perceptual factor (color appearance) was not necessary for the current results. In Experiment 3, response modulation by color labeling was investigated to clarify the influence of subjective labeling. Participants labeled a presented ambiguous color, which was a hue specification between two specific colors, by listening to the sound. The results revealed that the Stroop effect was caused only when the presented color was classified as the color related to the presented sound. This showed that subjective labeling played a role in the regulation of the effect of crossmodal correspondences. These findings should contribute to the explanation of crossmodal correspondences through semantic mediation. SAGE Publications 2023-08-30 /pmc/articles/PMC10467208/ /pubmed/37654696 http://dx.doi.org/10.1177/20416695231196835 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Standard Article
Miyamoto, Kenta
Taniyama, Yuma
Hine, Kyoko
Nakauchi, Shigeki
Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title_full Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title_fullStr Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title_full_unstemmed Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title_short Congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
title_sort congruency of color–sound crossmodal correspondence interacts with color and sound discrimination depending on color category
topic Standard Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10467208/
https://www.ncbi.nlm.nih.gov/pubmed/37654696
http://dx.doi.org/10.1177/20416695231196835
work_keys_str_mv AT miyamotokenta congruencyofcolorsoundcrossmodalcorrespondenceinteractswithcolorandsounddiscriminationdependingoncolorcategory
AT taniyamayuma congruencyofcolorsoundcrossmodalcorrespondenceinteractswithcolorandsounddiscriminationdependingoncolorcategory
AT hinekyoko congruencyofcolorsoundcrossmodalcorrespondenceinteractswithcolorandsounddiscriminationdependingoncolorcategory
AT nakauchishigeki congruencyofcolorsoundcrossmodalcorrespondenceinteractswithcolorandsounddiscriminationdependingoncolorcategory