Cargando…

Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions

BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multip...

Descripción completa

Detalles Bibliográficos
Autores principales: Tsantila, Fotini, Coppens, Evelien, De Witte, Hans, Abdulla, Kahar, Amann, Benedikt L., Arensman, Ella, Aust, Birgit, Creswell-Smith, Johanna, D’Alessandro, Luigia, De Winter, Lars, Doukani, Asmae, Fanaj, Naim, Greiner, Birgit, Griffin, Eve, Leduc, Caleb, Maxwell, Margaret, Connor, Cliodhna O’, Paterson, Charlotte, Purebl, György, Reich, Hanna, Ross, Victoria, Van Weeghel, Jaap, Van Audenhove, Chantal
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10276374/
https://www.ncbi.nlm.nih.gov/pubmed/37330460
http://dx.doi.org/10.1186/s12889-023-16092-x
_version_ 1785060062818992128
author Tsantila, Fotini
Coppens, Evelien
De Witte, Hans
Abdulla, Kahar
Amann, Benedikt L.
Arensman, Ella
Aust, Birgit
Creswell-Smith, Johanna
D’Alessandro, Luigia
De Winter, Lars
Doukani, Asmae
Fanaj, Naim
Greiner, Birgit
Griffin, Eve
Leduc, Caleb
Maxwell, Margaret
Connor, Cliodhna O’
Paterson, Charlotte
Purebl, György
Reich, Hanna
Ross, Victoria
Van Weeghel, Jaap
Van Audenhove, Chantal
author_facet Tsantila, Fotini
Coppens, Evelien
De Witte, Hans
Abdulla, Kahar
Amann, Benedikt L.
Arensman, Ella
Aust, Birgit
Creswell-Smith, Johanna
D’Alessandro, Luigia
De Winter, Lars
Doukani, Asmae
Fanaj, Naim
Greiner, Birgit
Griffin, Eve
Leduc, Caleb
Maxwell, Margaret
Connor, Cliodhna O’
Paterson, Charlotte
Purebl, György
Reich, Hanna
Ross, Victoria
Van Weeghel, Jaap
Van Audenhove, Chantal
author_sort Tsantila, Fotini
collection PubMed
description BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12889-023-16092-x.
format Online
Article
Text
id pubmed-10276374
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-102763742023-06-18 Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions Tsantila, Fotini Coppens, Evelien De Witte, Hans Abdulla, Kahar Amann, Benedikt L. Arensman, Ella Aust, Birgit Creswell-Smith, Johanna D’Alessandro, Luigia De Winter, Lars Doukani, Asmae Fanaj, Naim Greiner, Birgit Griffin, Eve Leduc, Caleb Maxwell, Margaret Connor, Cliodhna O’ Paterson, Charlotte Purebl, György Reich, Hanna Ross, Victoria Van Weeghel, Jaap Van Audenhove, Chantal BMC Public Health Research BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12889-023-16092-x. BioMed Central 2023-06-17 /pmc/articles/PMC10276374/ /pubmed/37330460 http://dx.doi.org/10.1186/s12889-023-16092-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Tsantila, Fotini
Coppens, Evelien
De Witte, Hans
Abdulla, Kahar
Amann, Benedikt L.
Arensman, Ella
Aust, Birgit
Creswell-Smith, Johanna
D’Alessandro, Luigia
De Winter, Lars
Doukani, Asmae
Fanaj, Naim
Greiner, Birgit
Griffin, Eve
Leduc, Caleb
Maxwell, Margaret
Connor, Cliodhna O’
Paterson, Charlotte
Purebl, György
Reich, Hanna
Ross, Victoria
Van Weeghel, Jaap
Van Audenhove, Chantal
Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_full Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_fullStr Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_full_unstemmed Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_short Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
title_sort developing a framework for evaluation: a theory of change for complex workplace mental health interventions
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10276374/
https://www.ncbi.nlm.nih.gov/pubmed/37330460
http://dx.doi.org/10.1186/s12889-023-16092-x
work_keys_str_mv AT tsantilafotini developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT coppensevelien developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT dewittehans developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT abdullakahar developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT amannbenediktl developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT arensmanella developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT austbirgit developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT creswellsmithjohanna developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT dalessandroluigia developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT dewinterlars developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT doukaniasmae developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT fanajnaim developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT greinerbirgit developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT griffineve developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT leduccaleb developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT maxwellmargaret developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT connorcliodhnao developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT patersoncharlotte developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT pureblgyorgy developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT reichhanna developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT rossvictoria developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT vanweegheljaap developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions
AT vanaudenhovechantal developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions