Cargando…

Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada

BACKGROUND: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongsid...

Descripción completa

Detalles Bibliográficos
Autores principales: Grimshaw, Jeremy M, Zwarenstein, Merrick, Tetroe, Jacqueline M, Godin, Gaston, Graham, Ian D, Lemyre, Louise, Eccles, Martin P, Johnston, Marie, Francis, Jillian J, Hux, Jan, O'Rourke, Keith, Légaré, France, Presseau, Justin
Formato: Texto
Lenguaje:English
Publicado: BioMed Central 2007
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2213685/
https://www.ncbi.nlm.nih.gov/pubmed/18039362
http://dx.doi.org/10.1186/1748-5908-2-38
_version_ 1782148934390513664
author Grimshaw, Jeremy M
Zwarenstein, Merrick
Tetroe, Jacqueline M
Godin, Gaston
Graham, Ian D
Lemyre, Louise
Eccles, Martin P
Johnston, Marie
Francis, Jillian J
Hux, Jan
O'Rourke, Keith
Légaré, France
Presseau, Justin
author_facet Grimshaw, Jeremy M
Zwarenstein, Merrick
Tetroe, Jacqueline M
Godin, Gaston
Graham, Ian D
Lemyre, Louise
Eccles, Martin P
Johnston, Marie
Francis, Jillian J
Hux, Jan
O'Rourke, Keith
Légaré, France
Presseau, Justin
author_sort Grimshaw, Jeremy M
collection PubMed
description BACKGROUND: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths). This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/DESIGN: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results. TRIAL REGISTRATION NUMBER: Current controlled trial ISRCTN72772651
format Text
id pubmed-2213685
institution National Center for Biotechnology Information
language English
publishDate 2007
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-22136852008-01-25 Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada Grimshaw, Jeremy M Zwarenstein, Merrick Tetroe, Jacqueline M Godin, Gaston Graham, Ian D Lemyre, Louise Eccles, Martin P Johnston, Marie Francis, Jillian J Hux, Jan O'Rourke, Keith Légaré, France Presseau, Justin Implement Sci Study Protocol BACKGROUND: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths). This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/DESIGN: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results. TRIAL REGISTRATION NUMBER: Current controlled trial ISRCTN72772651 BioMed Central 2007-11-26 /pmc/articles/PMC2213685/ /pubmed/18039362 http://dx.doi.org/10.1186/1748-5908-2-38 Text en Copyright © 2007 Grimshaw et al; licensee BioMed Central Ltd. http://creativecommons.org/licenses/by/2.0 This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( (http://creativecommons.org/licenses/by/2.0) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Study Protocol
Grimshaw, Jeremy M
Zwarenstein, Merrick
Tetroe, Jacqueline M
Godin, Gaston
Graham, Ian D
Lemyre, Louise
Eccles, Martin P
Johnston, Marie
Francis, Jillian J
Hux, Jan
O'Rourke, Keith
Légaré, France
Presseau, Justin
Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title_full Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title_fullStr Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title_full_unstemmed Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title_short Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada
title_sort looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the ontario printed educational message, opem) to improve referral and prescribing practices in primary care in ontario, canada
topic Study Protocol
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2213685/
https://www.ncbi.nlm.nih.gov/pubmed/18039362
http://dx.doi.org/10.1186/1748-5908-2-38
work_keys_str_mv AT grimshawjeremym lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT zwarensteinmerrick lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT tetroejacquelinem lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT godingaston lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT grahamiand lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT lemyrelouise lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT ecclesmartinp lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT johnstonmarie lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT francisjillianj lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT huxjan lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT orourkekeith lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT legarefrance lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada
AT presseaujustin lookinginsidetheblackboxatheorybasedprocessevaluationalongsidearandomisedcontrolledtrialofprintededucationalmaterialstheontarioprintededucationalmessageopemtoimprovereferralandprescribingpracticesinprimarycareinontariocanada