Cargando…

How to improve the design of experimental studies in computing education: Evidence from the international assessments

Cluster randomized trials are frequently used in educational research for methodological reasons. This study aims to improve the efficiency of cluster randomized trials on computer/information literacy and computational thinking. The study employs a two-level hierarchical linear model to estimate (i...

Descripción completa

Detalles Bibliográficos
Autores principales: Yildiz, Mustafa, Shi, Ran, Kara, Mehmet
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8754547/
https://www.ncbi.nlm.nih.gov/pubmed/35039744
http://dx.doi.org/10.1007/s10639-021-10800-z
_version_ 1784632294285246464
author Yildiz, Mustafa
Shi, Ran
Kara, Mehmet
author_facet Yildiz, Mustafa
Shi, Ran
Kara, Mehmet
author_sort Yildiz, Mustafa
collection PubMed
description Cluster randomized trials are frequently used in educational research for methodological reasons. This study aims to improve the efficiency of cluster randomized trials on computer/information literacy and computational thinking. The study employs a two-level hierarchical linear model to estimate (i) intraclass correlation coefficients, (ii) the amount of explained variances given selected predictors, and (iii) minimum detectable effect sizes given the set of plausible scenarios. Two data cycles from the International Computer and Information Study were used. The covariates at the student level are gender, interest in ICT, parents’ highest education level, ICT self-efficacy, and experience with computers. The covariates at school/teacher level are teacher’s ICT use, ratio of school size to the number of computers for student use, availability of ICT resources at school, approximate teacher age, and ICT self-efficacy. Findings showed that the most precise effect could be measured when student and teacher/school covariates are both adopted. Lastly, it was revealed that increasing the number of schools is effective to get the most precise effect.
format Online
Article
Text
id pubmed-8754547
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-87545472022-01-13 How to improve the design of experimental studies in computing education: Evidence from the international assessments Yildiz, Mustafa Shi, Ran Kara, Mehmet Educ Inf Technol (Dordr) Article Cluster randomized trials are frequently used in educational research for methodological reasons. This study aims to improve the efficiency of cluster randomized trials on computer/information literacy and computational thinking. The study employs a two-level hierarchical linear model to estimate (i) intraclass correlation coefficients, (ii) the amount of explained variances given selected predictors, and (iii) minimum detectable effect sizes given the set of plausible scenarios. Two data cycles from the International Computer and Information Study were used. The covariates at the student level are gender, interest in ICT, parents’ highest education level, ICT self-efficacy, and experience with computers. The covariates at school/teacher level are teacher’s ICT use, ratio of school size to the number of computers for student use, availability of ICT resources at school, approximate teacher age, and ICT self-efficacy. Findings showed that the most precise effect could be measured when student and teacher/school covariates are both adopted. Lastly, it was revealed that increasing the number of schools is effective to get the most precise effect. Springer US 2022-01-13 2022 /pmc/articles/PMC8754547/ /pubmed/35039744 http://dx.doi.org/10.1007/s10639-021-10800-z Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Yildiz, Mustafa
Shi, Ran
Kara, Mehmet
How to improve the design of experimental studies in computing education: Evidence from the international assessments
title How to improve the design of experimental studies in computing education: Evidence from the international assessments
title_full How to improve the design of experimental studies in computing education: Evidence from the international assessments
title_fullStr How to improve the design of experimental studies in computing education: Evidence from the international assessments
title_full_unstemmed How to improve the design of experimental studies in computing education: Evidence from the international assessments
title_short How to improve the design of experimental studies in computing education: Evidence from the international assessments
title_sort how to improve the design of experimental studies in computing education: evidence from the international assessments
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8754547/
https://www.ncbi.nlm.nih.gov/pubmed/35039744
http://dx.doi.org/10.1007/s10639-021-10800-z
work_keys_str_mv AT yildizmustafa howtoimprovethedesignofexperimentalstudiesincomputingeducationevidencefromtheinternationalassessments
AT shiran howtoimprovethedesignofexperimentalstudiesincomputingeducationevidencefromtheinternationalassessments
AT karamehmet howtoimprovethedesignofexperimentalstudiesincomputingeducationevidencefromtheinternationalassessments