Cargando…

Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

BACKGROUND: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability. METHODS: This study set up a multidisciplinary working gro...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Nan, Liu, Hui, Zhao, Wei, Pan, Yang, Lyu, Xiangzheng, Hao, Xiuyuan, Liu, Xiaoqing, Qi, Wen’an, Chen, Tong, Wang, Xiaoqin, Zhang, Boheng, Zhang, Weishe, Li, Qiu, Xu, Dong, Gao, Xinghua, Jin, Yinghui, Sun, Feng, Meng, Wenbo, Li, Guobao, Wu, Qijun, Chen, Ze, Wang, Xu, Estill, Janne, Norris, Susan L., Du, Liang, Chen, Yaolong, Wei, Junmin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Lippincott Williams & Wilkins 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10278700/
https://www.ncbi.nlm.nih.gov/pubmed/37192012
http://dx.doi.org/10.1097/CM9.0000000000002713
_version_ 1785060532056752128
author Yang, Nan
Liu, Hui
Zhao, Wei
Pan, Yang
Lyu, Xiangzheng
Hao, Xiuyuan
Liu, Xiaoqing
Qi, Wen’an
Chen, Tong
Wang, Xiaoqin
Zhang, Boheng
Zhang, Weishe
Li, Qiu
Xu, Dong
Gao, Xinghua
Jin, Yinghui
Sun, Feng
Meng, Wenbo
Li, Guobao
Wu, Qijun
Chen, Ze
Wang, Xu
Estill, Janne
Norris, Susan L.
Du, Liang
Chen, Yaolong
Wei, Junmin
author_facet Yang, Nan
Liu, Hui
Zhao, Wei
Pan, Yang
Lyu, Xiangzheng
Hao, Xiuyuan
Liu, Xiaoqing
Qi, Wen’an
Chen, Tong
Wang, Xiaoqin
Zhang, Boheng
Zhang, Weishe
Li, Qiu
Xu, Dong
Gao, Xinghua
Jin, Yinghui
Sun, Feng
Meng, Wenbo
Li, Guobao
Wu, Qijun
Chen, Ze
Wang, Xu
Estill, Janne
Norris, Susan L.
Du, Liang
Chen, Yaolong
Wei, Junmin
author_sort Yang, Nan
collection PubMed
description BACKGROUND: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability. METHODS: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability. RESULTS: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min. CONCLUSION: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.
format Online
Article
Text
id pubmed-10278700
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Lippincott Williams & Wilkins
record_format MEDLINE/PubMed
spelling pubmed-102787002023-06-20 Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines Yang, Nan Liu, Hui Zhao, Wei Pan, Yang Lyu, Xiangzheng Hao, Xiuyuan Liu, Xiaoqing Qi, Wen’an Chen, Tong Wang, Xiaoqin Zhang, Boheng Zhang, Weishe Li, Qiu Xu, Dong Gao, Xinghua Jin, Yinghui Sun, Feng Meng, Wenbo Li, Guobao Wu, Qijun Chen, Ze Wang, Xu Estill, Janne Norris, Susan L. Du, Liang Chen, Yaolong Wei, Junmin Chin Med J (Engl) Original Article BACKGROUND: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability. METHODS: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability. RESULTS: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min. CONCLUSION: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines. Lippincott Williams & Wilkins 2023-05-16 2023-06-20 /pmc/articles/PMC10278700/ /pubmed/37192012 http://dx.doi.org/10.1097/CM9.0000000000002713 Text en Copyright © 2023 The Chinese Medical Association, produced by Wolters Kluwer, Inc. under the CC-BY-NC-ND license. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal. http://creativecommons.org/licenses/by-nc-nd/4.0 (https://creativecommons.org/licenses/by-nc-nd/4.0/)
spellingShingle Original Article
Yang, Nan
Liu, Hui
Zhao, Wei
Pan, Yang
Lyu, Xiangzheng
Hao, Xiuyuan
Liu, Xiaoqing
Qi, Wen’an
Chen, Tong
Wang, Xiaoqin
Zhang, Boheng
Zhang, Weishe
Li, Qiu
Xu, Dong
Gao, Xinghua
Jin, Yinghui
Sun, Feng
Meng, Wenbo
Li, Guobao
Wu, Qijun
Chen, Ze
Wang, Xu
Estill, Janne
Norris, Susan L.
Du, Liang
Chen, Yaolong
Wei, Junmin
Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title_full Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title_fullStr Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title_full_unstemmed Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title_short Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines
title_sort development of the scientific, transparent and applicable rankings (star) tool for clinical practice guidelines
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10278700/
https://www.ncbi.nlm.nih.gov/pubmed/37192012
http://dx.doi.org/10.1097/CM9.0000000000002713
work_keys_str_mv AT yangnan developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT liuhui developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT zhaowei developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT panyang developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT lyuxiangzheng developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT haoxiuyuan developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT liuxiaoqing developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT qiwenan developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT chentong developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT wangxiaoqin developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT zhangboheng developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT zhangweishe developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT liqiu developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT xudong developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT gaoxinghua developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT jinyinghui developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT sunfeng developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT mengwenbo developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT liguobao developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT wuqijun developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT chenze developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT wangxu developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT estilljanne developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT norrissusanl developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT duliang developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT chenyaolong developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines
AT weijunmin developmentofthescientifictransparentandapplicablerankingsstartoolforclinicalpracticeguidelines