Cargando…
Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic acc...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6316756/ https://www.ncbi.nlm.nih.gov/pubmed/30249982 http://dx.doi.org/10.3390/diagnostics8040069 |
_version_ | 1783384605500375040 |
---|---|
author | Gerke, Oke Möller, Sören Debrabant, Birgit Halekoh, Ulrich Group, Odense Agreement Working |
author_facet | Gerke, Oke Möller, Sören Debrabant, Birgit Halekoh, Ulrich Group, Odense Agreement Working |
author_sort | Gerke, Oke |
collection | PubMed |
description | The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic accuracy studies, clinical trials, or epidemiological studies. As such, the study design may be compromised in terms of practicability issues, preventing the collection of sufficient results. We presented an example from a consultancy with a difficult mission and discussed five questions that concern the very nature of such a study (agreement vs. reliability; intra- vs. interrater), the rater population, explanatory factors in a multivariable model, and the statistical analysis strategy. Discussion of such basic methodological and statistical questions must take place before an investigation is started in order to ensure adequate data collection, to predict possible complications in the study, to plan sufficient statistical analyses, and to request timely assistance from an experienced statistician. GRRAS and its accompanying checklist of 15 items proved to be most helpful. Hopefully, our commentary will help improve the planning of agreement and reliability studies, which, in turn, will then be more focused, more appropriate, and more easily reported using GRRAS. |
format | Online Article Text |
id | pubmed-6316756 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-63167562019-01-11 Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View Gerke, Oke Möller, Sören Debrabant, Birgit Halekoh, Ulrich Group, Odense Agreement Working Diagnostics (Basel) Commentary The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic accuracy studies, clinical trials, or epidemiological studies. As such, the study design may be compromised in terms of practicability issues, preventing the collection of sufficient results. We presented an example from a consultancy with a difficult mission and discussed five questions that concern the very nature of such a study (agreement vs. reliability; intra- vs. interrater), the rater population, explanatory factors in a multivariable model, and the statistical analysis strategy. Discussion of such basic methodological and statistical questions must take place before an investigation is started in order to ensure adequate data collection, to predict possible complications in the study, to plan sufficient statistical analyses, and to request timely assistance from an experienced statistician. GRRAS and its accompanying checklist of 15 items proved to be most helpful. Hopefully, our commentary will help improve the planning of agreement and reliability studies, which, in turn, will then be more focused, more appropriate, and more easily reported using GRRAS. MDPI 2018-09-24 /pmc/articles/PMC6316756/ /pubmed/30249982 http://dx.doi.org/10.3390/diagnostics8040069 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Commentary Gerke, Oke Möller, Sören Debrabant, Birgit Halekoh, Ulrich Group, Odense Agreement Working Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title | Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title_full | Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title_fullStr | Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title_full_unstemmed | Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title_short | Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View |
title_sort | experience applying the guidelines for reporting reliability and agreement studies (grras) indicated five questions should be addressed in the planning phase from a statistical point of view |
topic | Commentary |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6316756/ https://www.ncbi.nlm.nih.gov/pubmed/30249982 http://dx.doi.org/10.3390/diagnostics8040069 |
work_keys_str_mv | AT gerkeoke experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview AT mollersoren experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview AT debrabantbirgit experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview AT halekohulrich experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview AT groupodenseagreementworking experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview |