Cargando…

Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines

BACKGROUND: The AGREE instrument has been validated for evaluating Clinical Practice Guidelines (CPG) pertaining to medical care. This study evaluated the reliability and validity of physical therapists using the AGREE to assess quality of CPGs relevant to physical therapy practice. METHODS: A total...

Descripción completa

Detalles Bibliográficos
Autores principales: MacDermid, Joy C, Brooks, Dina, Solway, Sherra, Switzer-McIntyre, Sharon, Brosseau, Lucie, Graham, Ian D
Formato: Texto
Lenguaje:English
Publicado: BioMed Central 2005
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC555572/
https://www.ncbi.nlm.nih.gov/pubmed/15743522
http://dx.doi.org/10.1186/1472-6963-5-18
_version_ 1782122540918898688
author MacDermid, Joy C
Brooks, Dina
Solway, Sherra
Switzer-McIntyre, Sharon
Brosseau, Lucie
Graham, Ian D
author_facet MacDermid, Joy C
Brooks, Dina
Solway, Sherra
Switzer-McIntyre, Sharon
Brosseau, Lucie
Graham, Ian D
author_sort MacDermid, Joy C
collection PubMed
description BACKGROUND: The AGREE instrument has been validated for evaluating Clinical Practice Guidelines (CPG) pertaining to medical care. This study evaluated the reliability and validity of physical therapists using the AGREE to assess quality of CPGs relevant to physical therapy practice. METHODS: A total of 69 physical therapists participated and were classified as generalists, specialist or researchers. Pairs of appraisers within each category evaluated independently, a set of 6 CPG selected at random from a pool of 55 CPGs. RESULTS: Reliability between pairs of appraisers indicated low to high reliability depending on the domain and number of appraisers (0.17–0.81 for single appraiser; 0.30–0.96 when score averaged across a pair of appraisers). The highest reliability was achieved for Rigour of Development, which exceeded ICC> 0.79, if scores from pairs of appraisers were pooled. Adding more than 3 appraisers did not consistently improve reliability. Appraiser type did not determine reliability scores. End-users, including study participants and a separate sample of 102 physical therapy students, found the AGREE useful to guide critical appraisal. The construct validity of the AGREE was supported in that expected differences on Rigour of Development domains were observed between expert panels versus those with no/uncertain expertise (differences of 10–21% p = 0.09–0.001). Factor analysis with varimax rotation, produced a 4-factor solution that was similar, although not in exact agreement with the AGREE Domains. Validity was also supported by the correlation observed (Kendall-tao = 0.69) between Overall Assessment and the Rigour of Development domain. CONCLUSION: These findings suggest that the AGREE instrument is reliable and valid when used by physiotherapists to assess the quality of CPG pertaining to physical therapy health services.
format Text
id pubmed-555572
institution National Center for Biotechnology Information
language English
publishDate 2005
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-5555722005-03-25 Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines MacDermid, Joy C Brooks, Dina Solway, Sherra Switzer-McIntyre, Sharon Brosseau, Lucie Graham, Ian D BMC Health Serv Res Research Article BACKGROUND: The AGREE instrument has been validated for evaluating Clinical Practice Guidelines (CPG) pertaining to medical care. This study evaluated the reliability and validity of physical therapists using the AGREE to assess quality of CPGs relevant to physical therapy practice. METHODS: A total of 69 physical therapists participated and were classified as generalists, specialist or researchers. Pairs of appraisers within each category evaluated independently, a set of 6 CPG selected at random from a pool of 55 CPGs. RESULTS: Reliability between pairs of appraisers indicated low to high reliability depending on the domain and number of appraisers (0.17–0.81 for single appraiser; 0.30–0.96 when score averaged across a pair of appraisers). The highest reliability was achieved for Rigour of Development, which exceeded ICC> 0.79, if scores from pairs of appraisers were pooled. Adding more than 3 appraisers did not consistently improve reliability. Appraiser type did not determine reliability scores. End-users, including study participants and a separate sample of 102 physical therapy students, found the AGREE useful to guide critical appraisal. The construct validity of the AGREE was supported in that expected differences on Rigour of Development domains were observed between expert panels versus those with no/uncertain expertise (differences of 10–21% p = 0.09–0.001). Factor analysis with varimax rotation, produced a 4-factor solution that was similar, although not in exact agreement with the AGREE Domains. Validity was also supported by the correlation observed (Kendall-tao = 0.69) between Overall Assessment and the Rigour of Development domain. CONCLUSION: These findings suggest that the AGREE instrument is reliable and valid when used by physiotherapists to assess the quality of CPG pertaining to physical therapy health services. BioMed Central 2005-03-02 /pmc/articles/PMC555572/ /pubmed/15743522 http://dx.doi.org/10.1186/1472-6963-5-18 Text en Copyright © 2005 MacDermid et al; licensee BioMed Central Ltd. http://creativecommons.org/licenses/by/2.0 This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( (http://creativecommons.org/licenses/by/2.0) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
MacDermid, Joy C
Brooks, Dina
Solway, Sherra
Switzer-McIntyre, Sharon
Brosseau, Lucie
Graham, Ian D
Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title_full Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title_fullStr Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title_full_unstemmed Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title_short Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines
title_sort reliability and validity of the agree instrument used by physical therapists in assessment of clinical practice guidelines
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC555572/
https://www.ncbi.nlm.nih.gov/pubmed/15743522
http://dx.doi.org/10.1186/1472-6963-5-18
work_keys_str_mv AT macdermidjoyc reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines
AT brooksdina reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines
AT solwaysherra reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines
AT switzermcintyresharon reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines
AT brosseaulucie reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines
AT grahamiand reliabilityandvalidityoftheagreeinstrumentusedbyphysicaltherapistsinassessmentofclinicalpracticeguidelines