Cargando…
Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions
BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multip...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10276374/ https://www.ncbi.nlm.nih.gov/pubmed/37330460 http://dx.doi.org/10.1186/s12889-023-16092-x |
_version_ | 1785060062818992128 |
---|---|
author | Tsantila, Fotini Coppens, Evelien De Witte, Hans Abdulla, Kahar Amann, Benedikt L. Arensman, Ella Aust, Birgit Creswell-Smith, Johanna D’Alessandro, Luigia De Winter, Lars Doukani, Asmae Fanaj, Naim Greiner, Birgit Griffin, Eve Leduc, Caleb Maxwell, Margaret Connor, Cliodhna O’ Paterson, Charlotte Purebl, György Reich, Hanna Ross, Victoria Van Weeghel, Jaap Van Audenhove, Chantal |
author_facet | Tsantila, Fotini Coppens, Evelien De Witte, Hans Abdulla, Kahar Amann, Benedikt L. Arensman, Ella Aust, Birgit Creswell-Smith, Johanna D’Alessandro, Luigia De Winter, Lars Doukani, Asmae Fanaj, Naim Greiner, Birgit Griffin, Eve Leduc, Caleb Maxwell, Margaret Connor, Cliodhna O’ Paterson, Charlotte Purebl, György Reich, Hanna Ross, Victoria Van Weeghel, Jaap Van Audenhove, Chantal |
author_sort | Tsantila, Fotini |
collection | PubMed |
description | BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12889-023-16092-x. |
format | Online Article Text |
id | pubmed-10276374 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-102763742023-06-18 Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions Tsantila, Fotini Coppens, Evelien De Witte, Hans Abdulla, Kahar Amann, Benedikt L. Arensman, Ella Aust, Birgit Creswell-Smith, Johanna D’Alessandro, Luigia De Winter, Lars Doukani, Asmae Fanaj, Naim Greiner, Birgit Griffin, Eve Leduc, Caleb Maxwell, Margaret Connor, Cliodhna O’ Paterson, Charlotte Purebl, György Reich, Hanna Ross, Victoria Van Weeghel, Jaap Van Audenhove, Chantal BMC Public Health Research BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12889-023-16092-x. BioMed Central 2023-06-17 /pmc/articles/PMC10276374/ /pubmed/37330460 http://dx.doi.org/10.1186/s12889-023-16092-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Tsantila, Fotini Coppens, Evelien De Witte, Hans Abdulla, Kahar Amann, Benedikt L. Arensman, Ella Aust, Birgit Creswell-Smith, Johanna D’Alessandro, Luigia De Winter, Lars Doukani, Asmae Fanaj, Naim Greiner, Birgit Griffin, Eve Leduc, Caleb Maxwell, Margaret Connor, Cliodhna O’ Paterson, Charlotte Purebl, György Reich, Hanna Ross, Victoria Van Weeghel, Jaap Van Audenhove, Chantal Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title | Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title_full | Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title_fullStr | Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title_full_unstemmed | Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title_short | Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions |
title_sort | developing a framework for evaluation: a theory of change for complex workplace mental health interventions |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10276374/ https://www.ncbi.nlm.nih.gov/pubmed/37330460 http://dx.doi.org/10.1186/s12889-023-16092-x |
work_keys_str_mv | AT tsantilafotini developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT coppensevelien developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT dewittehans developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT abdullakahar developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT amannbenediktl developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT arensmanella developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT austbirgit developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT creswellsmithjohanna developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT dalessandroluigia developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT dewinterlars developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT doukaniasmae developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT fanajnaim developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT greinerbirgit developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT griffineve developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT leduccaleb developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT maxwellmargaret developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT connorcliodhnao developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT patersoncharlotte developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT pureblgyorgy developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT reichhanna developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT rossvictoria developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT vanweegheljaap developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions AT vanaudenhovechantal developingaframeworkforevaluationatheoryofchangeforcomplexworkplacementalhealthinterventions |