Cargando…

The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)

BACKGROUND: Training is a core component in the implementation of empirically supported treatments, especially in the case of psychosocial interventions targeting mental illness. However, common forms of training are relatively ineffective in producing behavioral changes in providers. Trainers are i...

Descripción completa

Detalles Bibliográficos
Autores principales: Boyd, Meredith R., Lewis, Cara C., Scott, Kelli, Krendl, Anne, Lyon, Aaron R.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5457566/
https://www.ncbi.nlm.nih.gov/pubmed/28576148
http://dx.doi.org/10.1186/s13012-017-0603-y
_version_ 1783241566435934208
author Boyd, Meredith R.
Lewis, Cara C.
Scott, Kelli
Krendl, Anne
Lyon, Aaron R.
author_facet Boyd, Meredith R.
Lewis, Cara C.
Scott, Kelli
Krendl, Anne
Lyon, Aaron R.
author_sort Boyd, Meredith R.
collection PubMed
description BACKGROUND: Training is a core component in the implementation of empirically supported treatments, especially in the case of psychosocial interventions targeting mental illness. However, common forms of training are relatively ineffective in producing behavioral changes in providers. Trainers are in a strategic position to influence the success of training, but no research, to our knowledge, has explored whether personal characteristics of trainers (e.g., enthusiasm, charisma) increase effectiveness of training empirically supported treatments in the field of mental health. To address this gap, the current study created a measure of trainer characteristics (the Measure of Effective Attributes of Trainers (MEAT)) and assessed preliminary evidence for its reliability and validity by following gold standard measure development procedures. METHODS: Measure development consisted of three steps: (1) An initial pool of items was generated based on extant literature, input from the target population, and expert input; (2) target users of the measure interacted with the initial item pool to ensure face validity as well as clarity of measure instructions, response options, and items; and (3) a convenience sample viewed training videos and completed the measure resulting from step 2 to establish preliminary evidence of reliability and validity. An exploratory factor analysis was performed on the measure to determine whether latent factors (i.e., subscales of characteristics) underlie the data. RESULTS: The final solution consisted of two factors that demonstrated preliminary evidence for structural validity of the measure. The first factor, labeled “Charisma,” contained items related to characteristics that facilitate a positive personal relationship with the trainee (e.g., friendly, warm), and the second factor, labeled “Credibility,” contained items related to characteristics that emphasize the qualification of the trainer (e.g., professional, experienced). There was also evidence for face validity, content validity, reliability, and known groups validity of the measure. CONCLUSIONS: The MEAT demonstrated preliminary evidence of key psychometric properties. Future research is needed to further explore and contribute to its psychometric evidence, which could be done in conjunction with measures of trainee knowledge, attitudes towards empirically supported treatments, and evaluations of trainee behavior change to delineate key characteristics of trainers to be leveraged for more effective training. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-017-0603-y) contains supplementary material, which is available to authorized users.
format Online
Article
Text
id pubmed-5457566
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-54575662017-06-06 The creation and validation of the Measure of Effective Attributes of Trainers (MEAT) Boyd, Meredith R. Lewis, Cara C. Scott, Kelli Krendl, Anne Lyon, Aaron R. Implement Sci Short Report BACKGROUND: Training is a core component in the implementation of empirically supported treatments, especially in the case of psychosocial interventions targeting mental illness. However, common forms of training are relatively ineffective in producing behavioral changes in providers. Trainers are in a strategic position to influence the success of training, but no research, to our knowledge, has explored whether personal characteristics of trainers (e.g., enthusiasm, charisma) increase effectiveness of training empirically supported treatments in the field of mental health. To address this gap, the current study created a measure of trainer characteristics (the Measure of Effective Attributes of Trainers (MEAT)) and assessed preliminary evidence for its reliability and validity by following gold standard measure development procedures. METHODS: Measure development consisted of three steps: (1) An initial pool of items was generated based on extant literature, input from the target population, and expert input; (2) target users of the measure interacted with the initial item pool to ensure face validity as well as clarity of measure instructions, response options, and items; and (3) a convenience sample viewed training videos and completed the measure resulting from step 2 to establish preliminary evidence of reliability and validity. An exploratory factor analysis was performed on the measure to determine whether latent factors (i.e., subscales of characteristics) underlie the data. RESULTS: The final solution consisted of two factors that demonstrated preliminary evidence for structural validity of the measure. The first factor, labeled “Charisma,” contained items related to characteristics that facilitate a positive personal relationship with the trainee (e.g., friendly, warm), and the second factor, labeled “Credibility,” contained items related to characteristics that emphasize the qualification of the trainer (e.g., professional, experienced). There was also evidence for face validity, content validity, reliability, and known groups validity of the measure. CONCLUSIONS: The MEAT demonstrated preliminary evidence of key psychometric properties. Future research is needed to further explore and contribute to its psychometric evidence, which could be done in conjunction with measures of trainee knowledge, attitudes towards empirically supported treatments, and evaluations of trainee behavior change to delineate key characteristics of trainers to be leveraged for more effective training. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-017-0603-y) contains supplementary material, which is available to authorized users. BioMed Central 2017-06-02 /pmc/articles/PMC5457566/ /pubmed/28576148 http://dx.doi.org/10.1186/s13012-017-0603-y Text en © The Author(s). 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Short Report
Boyd, Meredith R.
Lewis, Cara C.
Scott, Kelli
Krendl, Anne
Lyon, Aaron R.
The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title_full The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title_fullStr The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title_full_unstemmed The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title_short The creation and validation of the Measure of Effective Attributes of Trainers (MEAT)
title_sort creation and validation of the measure of effective attributes of trainers (meat)
topic Short Report
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5457566/
https://www.ncbi.nlm.nih.gov/pubmed/28576148
http://dx.doi.org/10.1186/s13012-017-0603-y
work_keys_str_mv AT boydmeredithr thecreationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT lewiscarac thecreationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT scottkelli thecreationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT krendlanne thecreationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT lyonaaronr thecreationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT boydmeredithr creationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT lewiscarac creationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT scottkelli creationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT krendlanne creationandvalidationofthemeasureofeffectiveattributesoftrainersmeat
AT lyonaaronr creationandvalidationofthemeasureofeffectiveattributesoftrainersmeat