Cargando…
An exploration of the use of simple statistics to measure consensus and stability in Delphi studies
BACKGROUND: The criteria for stopping Delphi studies are often subjective. This study aimed to examine whether consensus and stability in the Delphi process can be ascertained by descriptive evaluation of trends in participants' views. METHODS: A three round email-based Delphi required particip...
Autores principales: | , , , |
---|---|
Formato: | Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2007
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2216026/ https://www.ncbi.nlm.nih.gov/pubmed/18045508 http://dx.doi.org/10.1186/1471-2288-7-52 |
_version_ | 1782149095221100544 |
---|---|
author | Holey, Elizabeth A Feeley, Jennifer L Dixon, John Whittaker, Vicki J |
author_facet | Holey, Elizabeth A Feeley, Jennifer L Dixon, John Whittaker, Vicki J |
author_sort | Holey, Elizabeth A |
collection | PubMed |
description | BACKGROUND: The criteria for stopping Delphi studies are often subjective. This study aimed to examine whether consensus and stability in the Delphi process can be ascertained by descriptive evaluation of trends in participants' views. METHODS: A three round email-based Delphi required participants (n = 12) to verify their level of agreement with 8 statements, write comments on each if they considered it necessary and rank the statements for importance. Each statement was analysed quantitatively by the percentage of agreement ratings, importance rankings and the amount of comments made for each statement, and qualitatively using thematic analysis. Importance rankings between rounds were compared by calculating Kappa values to observe trends in how the process impacts on subject's views. RESULTS: Evolution of consensus was shown by increase in agreement percentages, convergence of range with standard deviations of importance ratings, and a decrease in the number of comments made. Stability was demonstrated by a trend of increasing Kappa values. CONCLUSION: Following the original use of Delphi in social sciences, Delphi is suggested to be an effective way to gain and measure group consensus in healthcare. However, the proposed analytical process should be followed to ensure maximum validity of results in Delphi methodology for improved evidence of consensual decision-making. |
format | Text |
id | pubmed-2216026 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2007 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-22160262008-01-29 An exploration of the use of simple statistics to measure consensus and stability in Delphi studies Holey, Elizabeth A Feeley, Jennifer L Dixon, John Whittaker, Vicki J BMC Med Res Methodol Research Article BACKGROUND: The criteria for stopping Delphi studies are often subjective. This study aimed to examine whether consensus and stability in the Delphi process can be ascertained by descriptive evaluation of trends in participants' views. METHODS: A three round email-based Delphi required participants (n = 12) to verify their level of agreement with 8 statements, write comments on each if they considered it necessary and rank the statements for importance. Each statement was analysed quantitatively by the percentage of agreement ratings, importance rankings and the amount of comments made for each statement, and qualitatively using thematic analysis. Importance rankings between rounds were compared by calculating Kappa values to observe trends in how the process impacts on subject's views. RESULTS: Evolution of consensus was shown by increase in agreement percentages, convergence of range with standard deviations of importance ratings, and a decrease in the number of comments made. Stability was demonstrated by a trend of increasing Kappa values. CONCLUSION: Following the original use of Delphi in social sciences, Delphi is suggested to be an effective way to gain and measure group consensus in healthcare. However, the proposed analytical process should be followed to ensure maximum validity of results in Delphi methodology for improved evidence of consensual decision-making. BioMed Central 2007-11-29 /pmc/articles/PMC2216026/ /pubmed/18045508 http://dx.doi.org/10.1186/1471-2288-7-52 Text en Copyright © 2007 Holey et al; licensee BioMed Central Ltd. http://creativecommons.org/licenses/by/2.0 This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( (http://creativecommons.org/licenses/by/2.0) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Holey, Elizabeth A Feeley, Jennifer L Dixon, John Whittaker, Vicki J An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title | An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title_full | An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title_fullStr | An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title_full_unstemmed | An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title_short | An exploration of the use of simple statistics to measure consensus and stability in Delphi studies |
title_sort | exploration of the use of simple statistics to measure consensus and stability in delphi studies |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2216026/ https://www.ncbi.nlm.nih.gov/pubmed/18045508 http://dx.doi.org/10.1186/1471-2288-7-52 |
work_keys_str_mv | AT holeyelizabetha anexplorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT feeleyjenniferl anexplorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT dixonjohn anexplorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT whittakervickij anexplorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT holeyelizabetha explorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT feeleyjenniferl explorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT dixonjohn explorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies AT whittakervickij explorationoftheuseofsimplestatisticstomeasureconsensusandstabilityindelphistudies |