Cargando…
Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling eff...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937058/ https://www.ncbi.nlm.nih.gov/pubmed/36818066 http://dx.doi.org/10.3389/fpsyg.2023.861441 |
_version_ | 1784890352190095360 |
---|---|
author | Willoughby, Michael T. Camerota, Marie King, Katherine Merseth Nduku, Tabitha Piper, Benjamin |
author_facet | Willoughby, Michael T. Camerota, Marie King, Katherine Merseth Nduku, Tabitha Piper, Benjamin |
author_sort | Willoughby, Michael T. |
collection | PubMed |
description | Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling effects, which undermine measurement precision. We have previously demonstrated a general approach for scoring inhibitory control tasks that combines item-level accuracy and reaction-time information to minimize ceiling effects. Here, we extend that approach by incorporating additional item-level reaction time data from an adjunct (simple reaction time) task. We contrast three approaches for scoring inhibitory control tasks, two of which rely exclusively on item accuracy information and a third which also considers item reaction time information. We demonstrate the impacts of these different approaches to scoring with two inhibitory control tasks that were included in a recent evaluation of the Red Light, Purple Light intervention in preprimary classrooms in Nairobi County, Kenya. We limited our study to children who met inclusion criteria at pre-test (N = 418; 51% male; mean age = 4.8 years) or post-test (N = 386; 51% male; mean age = 4.8 years). Children’s performance on individual inhibitory control tasks was strongly correlated regardless of the scoring approach (rs = 0.73–0.97 across two tasks). However, the combined accuracy and reaction time scores eliminated ceiling effects that were common when only accuracy information was used. The combined accuracy and reaction time models also distinguished item-level RT into inhibitory control and processing speed components, which are distinct constructs. Results are discussed with respect to the challenges and nuances of the estimation and interpretation of inhibitory control task scores with children of varied ages and ability levels. |
format | Online Article Text |
id | pubmed-9937058 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-99370582023-02-18 Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children Willoughby, Michael T. Camerota, Marie King, Katherine Merseth Nduku, Tabitha Piper, Benjamin Front Psychol Psychology Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling effects, which undermine measurement precision. We have previously demonstrated a general approach for scoring inhibitory control tasks that combines item-level accuracy and reaction-time information to minimize ceiling effects. Here, we extend that approach by incorporating additional item-level reaction time data from an adjunct (simple reaction time) task. We contrast three approaches for scoring inhibitory control tasks, two of which rely exclusively on item accuracy information and a third which also considers item reaction time information. We demonstrate the impacts of these different approaches to scoring with two inhibitory control tasks that were included in a recent evaluation of the Red Light, Purple Light intervention in preprimary classrooms in Nairobi County, Kenya. We limited our study to children who met inclusion criteria at pre-test (N = 418; 51% male; mean age = 4.8 years) or post-test (N = 386; 51% male; mean age = 4.8 years). Children’s performance on individual inhibitory control tasks was strongly correlated regardless of the scoring approach (rs = 0.73–0.97 across two tasks). However, the combined accuracy and reaction time scores eliminated ceiling effects that were common when only accuracy information was used. The combined accuracy and reaction time models also distinguished item-level RT into inhibitory control and processing speed components, which are distinct constructs. Results are discussed with respect to the challenges and nuances of the estimation and interpretation of inhibitory control task scores with children of varied ages and ability levels. Frontiers Media S.A. 2023-02-03 /pmc/articles/PMC9937058/ /pubmed/36818066 http://dx.doi.org/10.3389/fpsyg.2023.861441 Text en Copyright © 2023 Willoughby, Camerota, King, Nduku and Piper. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Willoughby, Michael T. Camerota, Marie King, Katherine Merseth Nduku, Tabitha Piper, Benjamin Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title | Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title_full | Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title_fullStr | Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title_full_unstemmed | Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title_short | Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
title_sort | leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937058/ https://www.ncbi.nlm.nih.gov/pubmed/36818066 http://dx.doi.org/10.3389/fpsyg.2023.861441 |
work_keys_str_mv | AT willoughbymichaelt leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren AT camerotamarie leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren AT kingkatherinemerseth leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren AT ndukutabitha leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren AT piperbenjamin leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren |