Cargando…
Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire
BACKGROUND: The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal ada...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680279/ https://www.ncbi.nlm.nih.gov/pubmed/38008722 http://dx.doi.org/10.1186/s13584-023-00583-8 |
_version_ | 1785150693388058624 |
---|---|
author | Shalev, Ligat Helfrich, Christian D. Ellen, Moriah Avirame, Keren Eitan, Renana Rose, Adam J. |
author_facet | Shalev, Ligat Helfrich, Christian D. Ellen, Moriah Avirame, Keren Eitan, Renana Rose, Adam J. |
author_sort | Shalev, Ligat |
collection | PubMed |
description | BACKGROUND: The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal adaptations of existing tools which have not been subjected to formal validation. Best practices exist to guide researchers in adapting and validating research tools effectively. We present here, as an extended example, our validation of the SHEMESH questionnaire ('Organizational Readiness to Change Assessment'; In Hebrew: 'SHE'elon Muchanut Ergunit le'SHinuy'), a Hebrew-language version of the Organizational Readiness to Change Assessment (ORCA). SHEMESH is tailored to support implementation science projects, whose aim is to promote a more rapid and complete adoption of evidence-based health policies and practices. METHODS: The SHEMESH included originally eleven questions from the Evidence (item 1–4) and Context (items 5–11) domains. We validated SHEMESH through the following steps: 1. Professional translation to Hebrew and discussion of the translation by multidisciplinary committee; 2. Back-translation into English by a different translator to detect discrepancies; 3. Eleven cognitive interviews with psychiatric emergency department physicians and nurses; and 4. Pilot testing and psychometric analyses, including Cronbach’s alpha for subscales and factor analyses. RESULTS: Following translation and cognitive interviews, SHEMESH was administered to 222 psychiatrists and nurses. Pearson correlation showed significant and strong correlations of items 1–4 to the Evidence construct and items 6–11 to the Context construct. Item 5 did not correlate with the other items, and therefore was removed from the other psychometric procedures and eventually from the SHEMESH. Factor analysis with the remaining 10 items yielded two factors, which together explained a total of 69.7% of variance. Cronbach's Alpha scores for the two subscales were high (Evidence, 0.887, and Context, 0.852). CONCLUSIONS: This multi-step validation process of the SHEMESH questionnaire may serve as a comprehensive guideline for others who are willing to adapt research tools that were developed in other languages. Practically, SHEMESH has been validated for use in implementation science research projects in Israel. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13584-023-00583-8. |
format | Online Article Text |
id | pubmed-10680279 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-106802792023-11-26 Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire Shalev, Ligat Helfrich, Christian D. Ellen, Moriah Avirame, Keren Eitan, Renana Rose, Adam J. Isr J Health Policy Res Original Research Article BACKGROUND: The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal adaptations of existing tools which have not been subjected to formal validation. Best practices exist to guide researchers in adapting and validating research tools effectively. We present here, as an extended example, our validation of the SHEMESH questionnaire ('Organizational Readiness to Change Assessment'; In Hebrew: 'SHE'elon Muchanut Ergunit le'SHinuy'), a Hebrew-language version of the Organizational Readiness to Change Assessment (ORCA). SHEMESH is tailored to support implementation science projects, whose aim is to promote a more rapid and complete adoption of evidence-based health policies and practices. METHODS: The SHEMESH included originally eleven questions from the Evidence (item 1–4) and Context (items 5–11) domains. We validated SHEMESH through the following steps: 1. Professional translation to Hebrew and discussion of the translation by multidisciplinary committee; 2. Back-translation into English by a different translator to detect discrepancies; 3. Eleven cognitive interviews with psychiatric emergency department physicians and nurses; and 4. Pilot testing and psychometric analyses, including Cronbach’s alpha for subscales and factor analyses. RESULTS: Following translation and cognitive interviews, SHEMESH was administered to 222 psychiatrists and nurses. Pearson correlation showed significant and strong correlations of items 1–4 to the Evidence construct and items 6–11 to the Context construct. Item 5 did not correlate with the other items, and therefore was removed from the other psychometric procedures and eventually from the SHEMESH. Factor analysis with the remaining 10 items yielded two factors, which together explained a total of 69.7% of variance. Cronbach's Alpha scores for the two subscales were high (Evidence, 0.887, and Context, 0.852). CONCLUSIONS: This multi-step validation process of the SHEMESH questionnaire may serve as a comprehensive guideline for others who are willing to adapt research tools that were developed in other languages. Practically, SHEMESH has been validated for use in implementation science research projects in Israel. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13584-023-00583-8. BioMed Central 2023-11-26 /pmc/articles/PMC10680279/ /pubmed/38008722 http://dx.doi.org/10.1186/s13584-023-00583-8 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Original Research Article Shalev, Ligat Helfrich, Christian D. Ellen, Moriah Avirame, Keren Eitan, Renana Rose, Adam J. Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title | Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title_full | Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title_fullStr | Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title_full_unstemmed | Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title_short | Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire |
title_sort | bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the shemesh questionnaire |
topic | Original Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10680279/ https://www.ncbi.nlm.nih.gov/pubmed/38008722 http://dx.doi.org/10.1186/s13584-023-00583-8 |
work_keys_str_mv | AT shalevligat bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire AT helfrichchristiand bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire AT ellenmoriah bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire AT aviramekeren bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire AT eitanrenana bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire AT roseadamj bridginglanguagebarriersindevelopingvalidhealthpolicyresearchtoolsinsightsfromthetranslationandvalidationprocessoftheshemeshquestionnaire |