Cargando…
Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures
Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined wh...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862149/ https://www.ncbi.nlm.nih.gov/pubmed/36662146 http://dx.doi.org/10.3390/jintelligence11010016 |
_version_ | 1784875021207863296 |
---|---|
author | Zepeda, Cristina D. Nokes-Malach, Timothy J. |
author_facet | Zepeda, Cristina D. Nokes-Malach, Timothy J. |
author_sort | Zepeda, Cristina D. |
collection | PubMed |
description | Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined whether these measures assess the same metacognitive skills or are related to the same learning outcomes. To explore these questions, we investigated the relations between three metacognitive regulation measures given at various points during a learning activity and subsequent test. Verbal protocols were collected during the learning activity, questionnaire responses were collected after the learning tasks but before the test, and judgments of knowing (JOKs) were collected during the test. We found that the number of evaluation statements as measured via verbal protocols was positively associated with students’ responses on the control/debugging and evaluation components of the questionnaire. There were also two other positive trends. However, the number of monitoring statements was negatively associated with students’ responses on the monitoring component of the questionnaire and their JOKs on the later test. Each measure was also related to some aspect of performance, but the particular metacognitive skill, the direction of the effect, and the type of learning outcome differed across the measures. These results highlight the heterogeneity of outcomes across the measures, with each having different affordances and constraints for use in research and educational practice. |
format | Online Article Text |
id | pubmed-9862149 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-98621492023-01-22 Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures Zepeda, Cristina D. Nokes-Malach, Timothy J. J Intell Article Metacognition is hypothesized to play a central role in problem solving and self-regulated learning. Various measures have been developed to assess metacognitive regulation, including survey items in questionnaires, verbal protocols, and metacognitive judgments. However, few studies have examined whether these measures assess the same metacognitive skills or are related to the same learning outcomes. To explore these questions, we investigated the relations between three metacognitive regulation measures given at various points during a learning activity and subsequent test. Verbal protocols were collected during the learning activity, questionnaire responses were collected after the learning tasks but before the test, and judgments of knowing (JOKs) were collected during the test. We found that the number of evaluation statements as measured via verbal protocols was positively associated with students’ responses on the control/debugging and evaluation components of the questionnaire. There were also two other positive trends. However, the number of monitoring statements was negatively associated with students’ responses on the monitoring component of the questionnaire and their JOKs on the later test. Each measure was also related to some aspect of performance, but the particular metacognitive skill, the direction of the effect, and the type of learning outcome differed across the measures. These results highlight the heterogeneity of outcomes across the measures, with each having different affordances and constraints for use in research and educational practice. MDPI 2023-01-15 /pmc/articles/PMC9862149/ /pubmed/36662146 http://dx.doi.org/10.3390/jintelligence11010016 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zepeda, Cristina D. Nokes-Malach, Timothy J. Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title | Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title_full | Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title_fullStr | Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title_full_unstemmed | Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title_short | Assessing Metacognitive Regulation during Problem Solving: A Comparison of Three Measures |
title_sort | assessing metacognitive regulation during problem solving: a comparison of three measures |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862149/ https://www.ncbi.nlm.nih.gov/pubmed/36662146 http://dx.doi.org/10.3390/jintelligence11010016 |
work_keys_str_mv | AT zepedacristinad assessingmetacognitiveregulationduringproblemsolvingacomparisonofthreemeasures AT nokesmalachtimothyj assessingmetacognitiveregulationduringproblemsolvingacomparisonofthreemeasures |