Cargando…

On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study

In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the lit...

Descripción completa

Detalles Bibliográficos
Autores principales: Saltos-Rivas, Rafael, Novoa-Hernández, Pavel, Serrano Rodríguez, Rocío
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8432775/
https://www.ncbi.nlm.nih.gov/pubmed/34506585
http://dx.doi.org/10.1371/journal.pone.0257344
_version_ 1783751234719580160
author Saltos-Rivas, Rafael
Novoa-Hernández, Pavel
Serrano Rodríguez, Rocío
author_facet Saltos-Rivas, Rafael
Novoa-Hernández, Pavel
Serrano Rodríguez, Rocío
author_sort Saltos-Rivas, Rafael
collection PubMed
description In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the literature, 2) evaluate the reporting practice of quality assessments, and 3) analyze which variables explain such reporting practices. The results indicate that most of the studies focused on medium to large samples of European university students, who attended social science programs. Ad hoc, self-reported questionnaires measuring various digital competence areas were the most commonly used method for data collection. The studies were mostly published in low tier journals. 36% of the studies did not report any quality assessment, while less than 50% covered both groups of reliability and validity assessments at the same time. In general, the studies had a moderate to high depth of evidence on the assessments performed. We found that studies in which several areas of digital competence were measured were more likely to report quality assessments. In addition, we estimate that the probability of finding studies with acceptable or good reporting practices increases over time.
format Online
Article
Text
id pubmed-8432775
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-84327752021-09-11 On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study Saltos-Rivas, Rafael Novoa-Hernández, Pavel Serrano Rodríguez, Rocío PLoS One Research Article In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the literature, 2) evaluate the reporting practice of quality assessments, and 3) analyze which variables explain such reporting practices. The results indicate that most of the studies focused on medium to large samples of European university students, who attended social science programs. Ad hoc, self-reported questionnaires measuring various digital competence areas were the most commonly used method for data collection. The studies were mostly published in low tier journals. 36% of the studies did not report any quality assessment, while less than 50% covered both groups of reliability and validity assessments at the same time. In general, the studies had a moderate to high depth of evidence on the assessments performed. We found that studies in which several areas of digital competence were measured were more likely to report quality assessments. In addition, we estimate that the probability of finding studies with acceptable or good reporting practices increases over time. Public Library of Science 2021-09-10 /pmc/articles/PMC8432775/ /pubmed/34506585 http://dx.doi.org/10.1371/journal.pone.0257344 Text en © 2021 Saltos-Rivas et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Saltos-Rivas, Rafael
Novoa-Hernández, Pavel
Serrano Rodríguez, Rocío
On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title_full On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title_fullStr On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title_full_unstemmed On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title_short On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
title_sort on the quality of quantitative instruments to measure digital competence in higher education: a systematic mapping study
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8432775/
https://www.ncbi.nlm.nih.gov/pubmed/34506585
http://dx.doi.org/10.1371/journal.pone.0257344
work_keys_str_mv AT saltosrivasrafael onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy
AT novoahernandezpavel onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy
AT serranorodriguezrocio onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy