Cargando…
Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale
BACKGROUND: Enhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess i...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7470441/ https://www.ncbi.nlm.nih.gov/pubmed/32883352 http://dx.doi.org/10.1186/s13012-020-01030-x |
_version_ | 1783578589733584896 |
---|---|
author | Palinkas, Lawrence A. Chou, Chih-Ping Spear, Suzanne E. Mendon, Sapna J. Villamar, Juan Brown, C. Hendricks |
author_facet | Palinkas, Lawrence A. Chou, Chih-Ping Spear, Suzanne E. Mendon, Sapna J. Villamar, Juan Brown, C. Hendricks |
author_sort | Palinkas, Lawrence A. |
collection | PubMed |
description | BACKGROUND: Enhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess its reliability and construct validity for measuring both determinants and outcomes of efforts to sustain prevention programs and initiatives. METHODS: A 42-item scale comprised of items identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Cronbach’s alphas were used to determine inter-item reliability. Convergent validity was assessed by comparisons of a global measure of sustainment with current SAMHSA-funding status and continued operation in the same form. Discriminant validity was assessed by comparisons of sustainability determinants with whether or not the program had undergone adaptations. RESULTS: Confirmatory factor analysis provided support for a 35-item model fit to the data. Cronbach’s alpha was .84 for the sustainment outcome construct and ranged from .70 to .93 for the sustainability determinant constructs. All of the determinant constructs were significantly associated with sustainment outcome individual and global measures for the entire sample (p < 0.01 to 0.001) and for community-based programs and programs with a substance abuse focus (p < 0.05 to 0.001). Convergent validity was supported by significant associations between the global sustainment measure and current SAMHSA funding status and continued operation in the same form (p < 0.001). Four of the sustainability determinant constructs (responsive to community needs; coalitions, partnerships, and networks; organizational staff capability; and evaluation, feedback, and program outcomes) were also significantly associated with current SAMHSA funding status (p < 0.5 to 0.01). With the exception of organizational staff capability, all sustainability determinants were unrelated to program adaptation as predicted. CONCLUSIONS: The SMSS demonstrated good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback. |
format | Online Article Text |
id | pubmed-7470441 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-74704412020-09-08 Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale Palinkas, Lawrence A. Chou, Chih-Ping Spear, Suzanne E. Mendon, Sapna J. Villamar, Juan Brown, C. Hendricks Implement Sci Methodology BACKGROUND: Enhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess its reliability and construct validity for measuring both determinants and outcomes of efforts to sustain prevention programs and initiatives. METHODS: A 42-item scale comprised of items identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Cronbach’s alphas were used to determine inter-item reliability. Convergent validity was assessed by comparisons of a global measure of sustainment with current SAMHSA-funding status and continued operation in the same form. Discriminant validity was assessed by comparisons of sustainability determinants with whether or not the program had undergone adaptations. RESULTS: Confirmatory factor analysis provided support for a 35-item model fit to the data. Cronbach’s alpha was .84 for the sustainment outcome construct and ranged from .70 to .93 for the sustainability determinant constructs. All of the determinant constructs were significantly associated with sustainment outcome individual and global measures for the entire sample (p < 0.01 to 0.001) and for community-based programs and programs with a substance abuse focus (p < 0.05 to 0.001). Convergent validity was supported by significant associations between the global sustainment measure and current SAMHSA funding status and continued operation in the same form (p < 0.001). Four of the sustainability determinant constructs (responsive to community needs; coalitions, partnerships, and networks; organizational staff capability; and evaluation, feedback, and program outcomes) were also significantly associated with current SAMHSA funding status (p < 0.5 to 0.01). With the exception of organizational staff capability, all sustainability determinants were unrelated to program adaptation as predicted. CONCLUSIONS: The SMSS demonstrated good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback. BioMed Central 2020-09-03 /pmc/articles/PMC7470441/ /pubmed/32883352 http://dx.doi.org/10.1186/s13012-020-01030-x Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Methodology Palinkas, Lawrence A. Chou, Chih-Ping Spear, Suzanne E. Mendon, Sapna J. Villamar, Juan Brown, C. Hendricks Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title | Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title_full | Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title_fullStr | Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title_full_unstemmed | Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title_short | Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
title_sort | measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale |
topic | Methodology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7470441/ https://www.ncbi.nlm.nih.gov/pubmed/32883352 http://dx.doi.org/10.1186/s13012-020-01030-x |
work_keys_str_mv | AT palinkaslawrencea measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale AT chouchihping measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale AT spearsuzannee measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale AT mendonsapnaj measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale AT villamarjuan measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale AT brownchendricks measurementofsustainmentofpreventionprogramsandinitiativesthesustainmentmeasurementsystemscale |