Cargando…

Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on

The processing of idiomatic expressions is a topical issue in empirical research. Various factors have been found to influence idiom processing, such as idiom familiarity and idiom transparency. Information on these variables is usually obtained through norming studies. Studies investigating the eff...

Descripción completa

Detalles Bibliográficos
Autores principales: Hubers, Ferdy, Cucchiarini, Catia, Strik, Helmer, Dijkstra, Ton
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6527779/
https://www.ncbi.nlm.nih.gov/pubmed/31139119
http://dx.doi.org/10.3389/fpsyg.2019.01075
_version_ 1783420081326260224
author Hubers, Ferdy
Cucchiarini, Catia
Strik, Helmer
Dijkstra, Ton
author_facet Hubers, Ferdy
Cucchiarini, Catia
Strik, Helmer
Dijkstra, Ton
author_sort Hubers, Ferdy
collection PubMed
description The processing of idiomatic expressions is a topical issue in empirical research. Various factors have been found to influence idiom processing, such as idiom familiarity and idiom transparency. Information on these variables is usually obtained through norming studies. Studies investigating the effect of various properties on idiom processing have led to ambiguous results. This may be due to the variability of operationalizations of the idiom properties across norming studies, which in turn may affect the reliability of the subjective judgements. However, not all studies that collected normative data on idiomatic expressions investigated their reliability, and studies that did address the reliability of subjective ratings used various measures and produced mixed results. In this study, we investigated the reliability of subjective judgements, the relation between subjective and objective idiom frequency, and the impact of these dimensions on the participants’ idiom knowledge by collecting normative data of five subjective idiom properties (Frequency of Exposure, Meaning Familiarity, Frequency of Usage, Transparency, and Imageability) from 390 native speakers and objective corpus frequency for 374 Dutch idiomatic expressions. For reliability, we compared measures calculated in previous studies, with the D-coefficient, a metric taken from Generalizability Theory. High reliability was found for all subjective dimensions. One reliability metric, Krippendorff’s alpha, generally produced lower values, while similar values were obtained for three other measures (Cronbach’s alpha, Intraclass Correlation Coefficient, and the D-coefficient). Advantages of the D-coefficient are that it can be applied to unbalanced research designs, and to estimate the minimum number of raters required to obtain reliable ratings. Slightly higher coefficients were observed for so-called experience-based dimensions (Frequency of Exposure, Meaning Familiarity, and Frequency of Usage) than for content-based dimensions (Transparency and Imageability). In addition, fewer raters were required to obtain reliable ratings for the experience-based dimensions. Subjective and objective frequency appeared to be poorly correlated, while all subjective idiom properties and objective frequency turned out to affect idiom knowledge. Meaning Familiarity, Subjective and Objective Frequency of Exposure, Frequency of Usage, and Transparency positively contributed to idiom knowledge, while a negative effect was found for Imageability. We discuss these relationships in more detail, and give methodological recommendations with respect to the procedures and the measure to calculate reliability.
format Online
Article
Text
id pubmed-6527779
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-65277792019-05-28 Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on Hubers, Ferdy Cucchiarini, Catia Strik, Helmer Dijkstra, Ton Front Psychol Psychology The processing of idiomatic expressions is a topical issue in empirical research. Various factors have been found to influence idiom processing, such as idiom familiarity and idiom transparency. Information on these variables is usually obtained through norming studies. Studies investigating the effect of various properties on idiom processing have led to ambiguous results. This may be due to the variability of operationalizations of the idiom properties across norming studies, which in turn may affect the reliability of the subjective judgements. However, not all studies that collected normative data on idiomatic expressions investigated their reliability, and studies that did address the reliability of subjective ratings used various measures and produced mixed results. In this study, we investigated the reliability of subjective judgements, the relation between subjective and objective idiom frequency, and the impact of these dimensions on the participants’ idiom knowledge by collecting normative data of five subjective idiom properties (Frequency of Exposure, Meaning Familiarity, Frequency of Usage, Transparency, and Imageability) from 390 native speakers and objective corpus frequency for 374 Dutch idiomatic expressions. For reliability, we compared measures calculated in previous studies, with the D-coefficient, a metric taken from Generalizability Theory. High reliability was found for all subjective dimensions. One reliability metric, Krippendorff’s alpha, generally produced lower values, while similar values were obtained for three other measures (Cronbach’s alpha, Intraclass Correlation Coefficient, and the D-coefficient). Advantages of the D-coefficient are that it can be applied to unbalanced research designs, and to estimate the minimum number of raters required to obtain reliable ratings. Slightly higher coefficients were observed for so-called experience-based dimensions (Frequency of Exposure, Meaning Familiarity, and Frequency of Usage) than for content-based dimensions (Transparency and Imageability). In addition, fewer raters were required to obtain reliable ratings for the experience-based dimensions. Subjective and objective frequency appeared to be poorly correlated, while all subjective idiom properties and objective frequency turned out to affect idiom knowledge. Meaning Familiarity, Subjective and Objective Frequency of Exposure, Frequency of Usage, and Transparency positively contributed to idiom knowledge, while a negative effect was found for Imageability. We discuss these relationships in more detail, and give methodological recommendations with respect to the procedures and the measure to calculate reliability. Frontiers Media S.A. 2019-05-14 /pmc/articles/PMC6527779/ /pubmed/31139119 http://dx.doi.org/10.3389/fpsyg.2019.01075 Text en Copyright © 2019 Hubers, Cucchiarini, Strik and Dijkstra. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Hubers, Ferdy
Cucchiarini, Catia
Strik, Helmer
Dijkstra, Ton
Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title_full Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title_fullStr Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title_full_unstemmed Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title_short Normative Data of Dutch Idiomatic Expressions: Subjective Judgments You Can Bank on
title_sort normative data of dutch idiomatic expressions: subjective judgments you can bank on
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6527779/
https://www.ncbi.nlm.nih.gov/pubmed/31139119
http://dx.doi.org/10.3389/fpsyg.2019.01075
work_keys_str_mv AT hubersferdy normativedataofdutchidiomaticexpressionssubjectivejudgmentsyoucanbankon
AT cucchiarinicatia normativedataofdutchidiomaticexpressionssubjectivejudgmentsyoucanbankon
AT strikhelmer normativedataofdutchidiomaticexpressionssubjectivejudgmentsyoucanbankon
AT dijkstraton normativedataofdutchidiomaticexpressionssubjectivejudgmentsyoucanbankon