Cargando…

169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY

BACKGROUND AND AIMS: The ability to acquire the best evidence efficiently is important for busy healthcare professionals who have to make decision within a limited time. However, the current available assessment tools in evidence-based medicine (EBM), e.g. Berlin questionnaire and Fresno test, were...

Descripción completa

Detalles Bibliográficos
Autores principales: Chi, Ching-Chi, Tsai, Yu-Shiun, Fang, Tien-Pei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BMJ Publishing Group 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5759575/
http://dx.doi.org/10.1136/bmjopen-2016-015415.169
_version_ 1783291231031263232
author Chi, Ching-Chi
Tsai, Yu-Shiun
Fang, Tien-Pei
author_facet Chi, Ching-Chi
Tsai, Yu-Shiun
Fang, Tien-Pei
author_sort Chi, Ching-Chi
collection PubMed
description BACKGROUND AND AIMS: The ability to acquire the best evidence efficiently is important for busy healthcare professionals who have to make decision within a limited time. However, the current available assessment tools in evidence-based medicine (EBM), e.g. Berlin questionnaire and Fresno test, were not designed for examining evidence-searching capability. The objective of this study was to develop a scale for measuring evidence-searching skills. METHODS: We use 2-round modified Delphi technique and organised a workforce of 7 experts who provided comments on a draft 33-item scale and rated each item on a 5-point Likert-type scale. All items rated less than 3 by any expert were removed. The items were modified or merged after authors' discussion considering experts' comments. When all items were rated ≥3 by all experts with an interquartile range (IQR) of ≤1, a consensus was achieved. In a pilot test, the searching capability of two examinees was assessed by two raters and re-assessed two weeks later for reliability. In a further pilot test, the searching capability of another eight examinees was assessed by two raters and the reliability of the scale was examined. RESULTS: All 7 experts completed the two rounds. In Round 1, 33 items were removed and 11 items were merged into 4 items, leaving 17 items remained in the scale. In Round 2, 17 items were removed. The final consensus scale consisted of 15 items, all rated 4 or 5 with a mean of 4.79 and an IQR of 1 or less. The full details of the scale will be presented. In the pilot tests, the inter-rater correlation was 0.911 (95% confidence interval 0.821–0.956), while the intra-rater correlation coefficient was 1. The Cronbach's alpha was 0.903. CONCLUSION: This study is the first to develop a scale for measuring evidence-searching skills. The scale fills in the gap in objective assessment of knowledge-acquiring ability, and may be used in improving the training of evidence-searching skills.
format Online
Article
Text
id pubmed-5759575
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher BMJ Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-57595752018-02-12 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY Chi, Ching-Chi Tsai, Yu-Shiun Fang, Tien-Pei BMJ Open Abstracts from the 5th International Society for Evidence-Based Healthcare Congress, Kish Island, Ira BACKGROUND AND AIMS: The ability to acquire the best evidence efficiently is important for busy healthcare professionals who have to make decision within a limited time. However, the current available assessment tools in evidence-based medicine (EBM), e.g. Berlin questionnaire and Fresno test, were not designed for examining evidence-searching capability. The objective of this study was to develop a scale for measuring evidence-searching skills. METHODS: We use 2-round modified Delphi technique and organised a workforce of 7 experts who provided comments on a draft 33-item scale and rated each item on a 5-point Likert-type scale. All items rated less than 3 by any expert were removed. The items were modified or merged after authors' discussion considering experts' comments. When all items were rated ≥3 by all experts with an interquartile range (IQR) of ≤1, a consensus was achieved. In a pilot test, the searching capability of two examinees was assessed by two raters and re-assessed two weeks later for reliability. In a further pilot test, the searching capability of another eight examinees was assessed by two raters and the reliability of the scale was examined. RESULTS: All 7 experts completed the two rounds. In Round 1, 33 items were removed and 11 items were merged into 4 items, leaving 17 items remained in the scale. In Round 2, 17 items were removed. The final consensus scale consisted of 15 items, all rated 4 or 5 with a mean of 4.79 and an IQR of 1 or less. The full details of the scale will be presented. In the pilot tests, the inter-rater correlation was 0.911 (95% confidence interval 0.821–0.956), while the intra-rater correlation coefficient was 1. The Cronbach's alpha was 0.903. CONCLUSION: This study is the first to develop a scale for measuring evidence-searching skills. The scale fills in the gap in objective assessment of knowledge-acquiring ability, and may be used in improving the training of evidence-searching skills. BMJ Publishing Group 2017-02-08 /pmc/articles/PMC5759575/ http://dx.doi.org/10.1136/bmjopen-2016-015415.169 Text en Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/ This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
spellingShingle Abstracts from the 5th International Society for Evidence-Based Healthcare Congress, Kish Island, Ira
Chi, Ching-Chi
Tsai, Yu-Shiun
Fang, Tien-Pei
169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title_full 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title_fullStr 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title_full_unstemmed 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title_short 169: DEVELOPMENT OF A SCALE FOR MEASURING EVIDENCE-SEARCHING CAPABILITY: A MODIFIED DELPHI STUDY
title_sort 169: development of a scale for measuring evidence-searching capability: a modified delphi study
topic Abstracts from the 5th International Society for Evidence-Based Healthcare Congress, Kish Island, Ira
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5759575/
http://dx.doi.org/10.1136/bmjopen-2016-015415.169
work_keys_str_mv AT chichingchi 169developmentofascaleformeasuringevidencesearchingcapabilityamodifieddelphistudy
AT tsaiyushiun 169developmentofascaleformeasuringevidencesearchingcapabilityamodifieddelphistudy
AT fangtienpei 169developmentofascaleformeasuringevidencesearchingcapabilityamodifieddelphistudy