Cargando…
Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are cur...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications Inc.
2015
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4642407/ https://www.ncbi.nlm.nih.gov/pubmed/26399428 http://dx.doi.org/10.2196/jmir.4943 |
_version_ | 1782400361039921152 |
---|---|
author | Alber, Julia M Bernhardt, Jay M Stellefson, Michael Weiler, Robert M Anderson-Lewis, Charkarra Miller, M David MacInnes, Jann |
author_facet | Alber, Julia M Bernhardt, Jay M Stellefson, Michael Weiler, Robert M Anderson-Lewis, Charkarra Miller, M David MacInnes, Jann |
author_sort | Alber, Julia M |
collection | PubMed |
description | BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). OBJECTIVE: The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. METHODS: The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. RESULTS: Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. CONCLUSIONS: Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES. |
format | Online Article Text |
id | pubmed-4642407 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2015 |
publisher | JMIR Publications Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-46424072016-01-12 Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists Alber, Julia M Bernhardt, Jay M Stellefson, Michael Weiler, Robert M Anderson-Lewis, Charkarra Miller, M David MacInnes, Jann J Med Internet Res Original Paper BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). OBJECTIVE: The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. METHODS: The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. RESULTS: Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. CONCLUSIONS: Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES. JMIR Publications Inc. 2015-09-23 /pmc/articles/PMC4642407/ /pubmed/26399428 http://dx.doi.org/10.2196/jmir.4943 Text en ©Julia M Alber, Jay M Bernhardt, Michael Stellefson, Robert M Weiler, Charkarra Anderson-Lewis, M David Miller, Jann MacInnes. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.09.2015. https://creativecommons.org/licenses/by/2.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/ (https://creativecommons.org/licenses/by/2.0/) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Alber, Julia M Bernhardt, Jay M Stellefson, Michael Weiler, Robert M Anderson-Lewis, Charkarra Miller, M David MacInnes, Jann Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title | Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title_full | Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title_fullStr | Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title_full_unstemmed | Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title_short | Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists |
title_sort | designing and testing an inventory for measuring social media competency of certified health education specialists |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4642407/ https://www.ncbi.nlm.nih.gov/pubmed/26399428 http://dx.doi.org/10.2196/jmir.4943 |
work_keys_str_mv | AT alberjuliam designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT bernhardtjaym designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT stellefsonmichael designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT weilerrobertm designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT andersonlewischarkarra designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT millermdavid designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists AT macinnesjann designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists |