Cargando…

Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures

Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined wh...

Descripción completa

Detalles Bibliográficos
Autores principales: Zepeda, Cristina D., Nokes-Malach, Timothy J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862149/
https://www.ncbi.nlm.nih.gov/pubmed/36662146
http://dx.doi.org/10.3390/jintelligence11010016
_version_ 1784875021207863296
author Zepeda, Cristina D.
Nokes-Malach, Timothy J.
author_facet Zepeda, Cristina D.
Nokes-Malach, Timothy J.
author_sort Zepeda, Cristina D.
collection PubMed
description Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined whether these measures assess the same metacognitive skills or are related to the same learning outcomes. To explore these questions, we investigated the relations between three metacognitive regulation measures given at various points during a learning activity and subsequent test. Verbal protocols were collected during the learning activity, questionnaire responses were collected after the learning tasks but before the test, and judgments of knowing (JOKs) were collected during the test. We found that the number of evaluation statements as measured via verbal protocols was positively associated with students’ responses on the control/debugging and evaluation components of the questionnaire. There were also two other positive trends. However, the number of monitoring statements was negatively associated with students’ responses on the monitoring component of the questionnaire and their JOKs on the later test. Each measure was also related to some aspect of performance, but the particular metacognitive skill, the direction of the effect, and the type of learning outcome differed across the measures. These results highlight the heterogeneity of outcomes across the measures, with each having different affordances and constraints for use in research and educational practice.
format Online
Article
Text
id pubmed-9862149
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98621492023-01-22 Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures Zepeda, Cristina D. Nokes-Malach, Timothy J. J Intell Article Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined whether these measures assess the same metacognitive skills or are related to the same learning outcomes. To explore these questions, we investigated the relations between three metacognitive regulation measures given at various points during a learning activity and subsequent test. Verbal protocols were collected during the learning activity, questionnaire responses were collected after the learning tasks but before the test, and judgments of knowing (JOKs) were collected during the test. We found that the number of evaluation statements as measured via verbal protocols was positively associated with students’ responses on the control/debugging and evaluation components of the questionnaire. There were also two other positive trends. However, the number of monitoring statements was negatively associated with students’ responses on the monitoring component of the questionnaire and their JOKs on the later test. Each measure was also related to some aspect of performance, but the particular metacognitive skill, the direction of the effect, and the type of learning outcome differed across the measures. These results highlight the heterogeneity of outcomes across the measures, with each having different affordances and constraints for use in research and educational practice. MDPI 2023-01-15 /pmc/articles/PMC9862149/ /pubmed/36662146 http://dx.doi.org/10.3390/jintelligence11010016 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zepeda, Cristina D.
Nokes-Malach, Timothy J.
Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title_full Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title_fullStr Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title_full_unstemmed Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title_short Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
title_sort assessing metacognitive regulation during problem solving: a comparison of three measures
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862149/
https://www.ncbi.nlm.nih.gov/pubmed/36662146
http://dx.doi.org/10.3390/jintelligence11010016
work_keys_str_mv AT zepedacristinad assessingmetacognitiveregulationduringproblemsolvingacomparisonofthreemeasures
AT nokesmalachtimothyj assessingmetacognitiveregulationduringproblemsolvingacomparisonofthreemeasures