Cargando…
Reliability of Judging in DanceSport
PURPOSE: The aim of this study was to assess the reliability and validity of the new judging system in DanceSport. METHODS: Eighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. A...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6524706/ https://www.ncbi.nlm.nih.gov/pubmed/31133935 http://dx.doi.org/10.3389/fpsyg.2019.01001 |
_version_ | 1783419597337133056 |
---|---|
author | Premelč, Jerneja Vučković, Goran James, Nic Leskošek, Bojan |
author_facet | Premelč, Jerneja Vučković, Goran James, Nic Leskošek, Bojan |
author_sort | Premelč, Jerneja |
collection | PubMed |
description | PURPOSE: The aim of this study was to assess the reliability and validity of the new judging system in DanceSport. METHODS: Eighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. Absolute agreement and consistency of judging were calculated for all main judging criteria and sub-criteria. RESULTS: A mean correlation of overall judging marks was 0.48. Kendall’s coefficient of concordance for overall marks (W = 0.58) suggesting relatively low agreement among judges. Slightly lower coefficients were found for the artistic part [Partnering skills (W = 0.45) and Choreography and performance (W = 0.49)] compared to the technical part [Technical qualities (W = 0.56) and Movement to music (W = 0.54)]. ICC for overall criteria was low for absolute agreement [ICC(2,3) = 0.62] but higher for consistency [ICC(3,3) = 0.80]. CONCLUSION: The relatively large differences between judges’ marks suggest that judges either disagreed to some extent on the quality of the dancing or used the judging scale in different ways. The biggest concern was standard error of measurement (SEM) which was often larger than the difference between dancers scores suggesting that this judging system lacks validity. This was the first research to assess judging in DanceSport and offers suggestions to potentially improve both its objectivity and validity in the future. |
format | Online Article Text |
id | pubmed-6524706 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-65247062019-05-27 Reliability of Judging in DanceSport Premelč, Jerneja Vučković, Goran James, Nic Leskošek, Bojan Front Psychol Psychology PURPOSE: The aim of this study was to assess the reliability and validity of the new judging system in DanceSport. METHODS: Eighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. Absolute agreement and consistency of judging were calculated for all main judging criteria and sub-criteria. RESULTS: A mean correlation of overall judging marks was 0.48. Kendall’s coefficient of concordance for overall marks (W = 0.58) suggesting relatively low agreement among judges. Slightly lower coefficients were found for the artistic part [Partnering skills (W = 0.45) and Choreography and performance (W = 0.49)] compared to the technical part [Technical qualities (W = 0.56) and Movement to music (W = 0.54)]. ICC for overall criteria was low for absolute agreement [ICC(2,3) = 0.62] but higher for consistency [ICC(3,3) = 0.80]. CONCLUSION: The relatively large differences between judges’ marks suggest that judges either disagreed to some extent on the quality of the dancing or used the judging scale in different ways. The biggest concern was standard error of measurement (SEM) which was often larger than the difference between dancers scores suggesting that this judging system lacks validity. This was the first research to assess judging in DanceSport and offers suggestions to potentially improve both its objectivity and validity in the future. Frontiers Media S.A. 2019-05-07 /pmc/articles/PMC6524706/ /pubmed/31133935 http://dx.doi.org/10.3389/fpsyg.2019.01001 Text en Copyright © 2019 Premelč, Vučković, James and Leskošek. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Premelč, Jerneja Vučković, Goran James, Nic Leskošek, Bojan Reliability of Judging in DanceSport |
title | Reliability of Judging in DanceSport |
title_full | Reliability of Judging in DanceSport |
title_fullStr | Reliability of Judging in DanceSport |
title_full_unstemmed | Reliability of Judging in DanceSport |
title_short | Reliability of Judging in DanceSport |
title_sort | reliability of judging in dancesport |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6524706/ https://www.ncbi.nlm.nih.gov/pubmed/31133935 http://dx.doi.org/10.3389/fpsyg.2019.01001 |
work_keys_str_mv | AT premelcjerneja reliabilityofjudgingindancesport AT vuckovicgoran reliabilityofjudgingindancesport AT jamesnic reliabilityofjudgingindancesport AT leskosekbojan reliabilityofjudgingindancesport |