Cargando…
On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study
In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the lit...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8432775/ https://www.ncbi.nlm.nih.gov/pubmed/34506585 http://dx.doi.org/10.1371/journal.pone.0257344 |
_version_ | 1783751234719580160 |
---|---|
author | Saltos-Rivas, Rafael Novoa-Hernández, Pavel Serrano Rodríguez, Rocío |
author_facet | Saltos-Rivas, Rafael Novoa-Hernández, Pavel Serrano Rodríguez, Rocío |
author_sort | Saltos-Rivas, Rafael |
collection | PubMed |
description | In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the literature, 2) evaluate the reporting practice of quality assessments, and 3) analyze which variables explain such reporting practices. The results indicate that most of the studies focused on medium to large samples of European university students, who attended social science programs. Ad hoc, self-reported questionnaires measuring various digital competence areas were the most commonly used method for data collection. The studies were mostly published in low tier journals. 36% of the studies did not report any quality assessment, while less than 50% covered both groups of reliability and validity assessments at the same time. In general, the studies had a moderate to high depth of evidence on the assessments performed. We found that studies in which several areas of digital competence were measured were more likely to report quality assessments. In addition, we estimate that the probability of finding studies with acceptable or good reporting practices increases over time. |
format | Online Article Text |
id | pubmed-8432775 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-84327752021-09-11 On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study Saltos-Rivas, Rafael Novoa-Hernández, Pavel Serrano Rodríguez, Rocío PLoS One Research Article In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the literature, 2) evaluate the reporting practice of quality assessments, and 3) analyze which variables explain such reporting practices. The results indicate that most of the studies focused on medium to large samples of European university students, who attended social science programs. Ad hoc, self-reported questionnaires measuring various digital competence areas were the most commonly used method for data collection. The studies were mostly published in low tier journals. 36% of the studies did not report any quality assessment, while less than 50% covered both groups of reliability and validity assessments at the same time. In general, the studies had a moderate to high depth of evidence on the assessments performed. We found that studies in which several areas of digital competence were measured were more likely to report quality assessments. In addition, we estimate that the probability of finding studies with acceptable or good reporting practices increases over time. Public Library of Science 2021-09-10 /pmc/articles/PMC8432775/ /pubmed/34506585 http://dx.doi.org/10.1371/journal.pone.0257344 Text en © 2021 Saltos-Rivas et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Saltos-Rivas, Rafael Novoa-Hernández, Pavel Serrano Rodríguez, Rocío On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title | On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title_full | On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title_fullStr | On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title_full_unstemmed | On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title_short | On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study |
title_sort | on the quality of quantitative instruments to measure digital competence in higher education: a systematic mapping study |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8432775/ https://www.ncbi.nlm.nih.gov/pubmed/34506585 http://dx.doi.org/10.1371/journal.pone.0257344 |
work_keys_str_mv | AT saltosrivasrafael onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy AT novoahernandezpavel onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy AT serranorodriguezrocio onthequalityofquantitativeinstrumentstomeasuredigitalcompetenceinhighereducationasystematicmappingstudy |