Cargando…

Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View

The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic acc...

Descripción completa

Detalles Bibliográficos
Autores principales: Gerke, Oke, Möller, Sören, Debrabant, Birgit, Halekoh, Ulrich, Group, Odense Agreement Working
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6316756/
https://www.ncbi.nlm.nih.gov/pubmed/30249982
http://dx.doi.org/10.3390/diagnostics8040069
_version_ 1783384605500375040
author Gerke, Oke
Möller, Sören
Debrabant, Birgit
Halekoh, Ulrich
Group, Odense Agreement Working
author_facet Gerke, Oke
Möller, Sören
Debrabant, Birgit
Halekoh, Ulrich
Group, Odense Agreement Working
author_sort Gerke, Oke
collection PubMed
description The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic accuracy studies, clinical trials, or epidemiological studies. As such, the study design may be compromised in terms of practicability issues, preventing the collection of sufficient results. We presented an example from a consultancy with a difficult mission and discussed five questions that concern the very nature of such a study (agreement vs. reliability; intra- vs. interrater), the rater population, explanatory factors in a multivariable model, and the statistical analysis strategy. Discussion of such basic methodological and statistical questions must take place before an investigation is started in order to ensure adequate data collection, to predict possible complications in the study, to plan sufficient statistical analyses, and to request timely assistance from an experienced statistician. GRRAS and its accompanying checklist of 15 items proved to be most helpful. Hopefully, our commentary will help improve the planning of agreement and reliability studies, which, in turn, will then be more focused, more appropriate, and more easily reported using GRRAS.
format Online
Article
Text
id pubmed-6316756
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-63167562019-01-11 Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View Gerke, Oke Möller, Sören Debrabant, Birgit Halekoh, Ulrich Group, Odense Agreement Working Diagnostics (Basel) Commentary The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed in 2011 to support transparent and accurate reporting. These studies may be conducted with the primary aim of estimating reliability and/or agreement itself, but are more often than not part of larger diagnostic accuracy studies, clinical trials, or epidemiological studies. As such, the study design may be compromised in terms of practicability issues, preventing the collection of sufficient results. We presented an example from a consultancy with a difficult mission and discussed five questions that concern the very nature of such a study (agreement vs. reliability; intra- vs. interrater), the rater population, explanatory factors in a multivariable model, and the statistical analysis strategy. Discussion of such basic methodological and statistical questions must take place before an investigation is started in order to ensure adequate data collection, to predict possible complications in the study, to plan sufficient statistical analyses, and to request timely assistance from an experienced statistician. GRRAS and its accompanying checklist of 15 items proved to be most helpful. Hopefully, our commentary will help improve the planning of agreement and reliability studies, which, in turn, will then be more focused, more appropriate, and more easily reported using GRRAS. MDPI 2018-09-24 /pmc/articles/PMC6316756/ /pubmed/30249982 http://dx.doi.org/10.3390/diagnostics8040069 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Commentary
Gerke, Oke
Möller, Sören
Debrabant, Birgit
Halekoh, Ulrich
Group, Odense Agreement Working
Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title_full Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title_fullStr Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title_full_unstemmed Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title_short Experience Applying the Guidelines for Reporting Reliability and Agreement Studies (GRRAS) Indicated Five Questions Should Be Addressed in the Planning Phase from a Statistical Point of View
title_sort experience applying the guidelines for reporting reliability and agreement studies (grras) indicated five questions should be addressed in the planning phase from a statistical point of view
topic Commentary
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6316756/
https://www.ncbi.nlm.nih.gov/pubmed/30249982
http://dx.doi.org/10.3390/diagnostics8040069
work_keys_str_mv AT gerkeoke experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview
AT mollersoren experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview
AT debrabantbirgit experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview
AT halekohulrich experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview
AT groupodenseagreementworking experienceapplyingtheguidelinesforreportingreliabilityandagreementstudiesgrrasindicatedfivequestionsshouldbeaddressedintheplanningphasefromastatisticalpointofview