Cargando…

Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists

BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are cur...

Descripción completa

Detalles Bibliográficos
Autores principales: Alber, Julia M, Bernhardt, Jay M, Stellefson, Michael, Weiler, Robert M, Anderson-Lewis, Charkarra, Miller, M David, MacInnes, Jann
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications Inc. 2015
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4642407/
https://www.ncbi.nlm.nih.gov/pubmed/26399428
http://dx.doi.org/10.2196/jmir.4943
_version_ 1782400361039921152
author Alber, Julia M
Bernhardt, Jay M
Stellefson, Michael
Weiler, Robert M
Anderson-Lewis, Charkarra
Miller, M David
MacInnes, Jann
author_facet Alber, Julia M
Bernhardt, Jay M
Stellefson, Michael
Weiler, Robert M
Anderson-Lewis, Charkarra
Miller, M David
MacInnes, Jann
author_sort Alber, Julia M
collection PubMed
description BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). OBJECTIVE: The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. METHODS: The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. RESULTS: Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. CONCLUSIONS: Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES.
format Online
Article
Text
id pubmed-4642407
institution National Center for Biotechnology Information
language English
publishDate 2015
publisher JMIR Publications Inc.
record_format MEDLINE/PubMed
spelling pubmed-46424072016-01-12 Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists Alber, Julia M Bernhardt, Jay M Stellefson, Michael Weiler, Robert M Anderson-Lewis, Charkarra Miller, M David MacInnes, Jann J Med Internet Res Original Paper BACKGROUND: Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). OBJECTIVE: The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. METHODS: The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. RESULTS: Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. CONCLUSIONS: Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES. JMIR Publications Inc. 2015-09-23 /pmc/articles/PMC4642407/ /pubmed/26399428 http://dx.doi.org/10.2196/jmir.4943 Text en ©Julia M Alber, Jay M Bernhardt, Michael Stellefson, Robert M Weiler, Charkarra Anderson-Lewis, M David Miller, Jann MacInnes. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.09.2015. https://creativecommons.org/licenses/by/2.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/ (https://creativecommons.org/licenses/by/2.0/) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Alber, Julia M
Bernhardt, Jay M
Stellefson, Michael
Weiler, Robert M
Anderson-Lewis, Charkarra
Miller, M David
MacInnes, Jann
Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title_full Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title_fullStr Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title_full_unstemmed Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title_short Designing and Testing an Inventory for Measuring Social Media Competency of Certified Health Education Specialists
title_sort designing and testing an inventory for measuring social media competency of certified health education specialists
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4642407/
https://www.ncbi.nlm.nih.gov/pubmed/26399428
http://dx.doi.org/10.2196/jmir.4943
work_keys_str_mv AT alberjuliam designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT bernhardtjaym designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT stellefsonmichael designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT weilerrobertm designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT andersonlewischarkarra designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT millermdavid designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists
AT macinnesjann designingandtestinganinventoryformeasuringsocialmediacompetencyofcertifiedhealtheducationspecialists