Cargando…

Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children

Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling eff...

Descripción completa

Detalles Bibliográficos
Autores principales: Willoughby, Michael T., Camerota, Marie, King, Katherine Merseth, Nduku, Tabitha, Piper, Benjamin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937058/
https://www.ncbi.nlm.nih.gov/pubmed/36818066
http://dx.doi.org/10.3389/fpsyg.2023.861441
_version_ 1784890352190095360
author Willoughby, Michael T.
Camerota, Marie
King, Katherine Merseth
Nduku, Tabitha
Piper, Benjamin
author_facet Willoughby, Michael T.
Camerota, Marie
King, Katherine Merseth
Nduku, Tabitha
Piper, Benjamin
author_sort Willoughby, Michael T.
collection PubMed
description Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling effects, which undermine measurement precision. We have previously demonstrated a general approach for scoring inhibitory control tasks that combines item-level accuracy and reaction-time information to minimize ceiling effects. Here, we extend that approach by incorporating additional item-level reaction time data from an adjunct (simple reaction time) task. We contrast three approaches for scoring inhibitory control tasks, two of which rely exclusively on item accuracy information and a third which also considers item reaction time information. We demonstrate the impacts of these different approaches to scoring with two inhibitory control tasks that were included in a recent evaluation of the Red Light, Purple Light intervention in preprimary classrooms in Nairobi County, Kenya. We limited our study to children who met inclusion criteria at pre-test (N = 418; 51% male; mean age = 4.8 years) or post-test (N = 386; 51% male; mean age = 4.8 years). Children’s performance on individual inhibitory control tasks was strongly correlated regardless of the scoring approach (rs = 0.73–0.97 across two tasks). However, the combined accuracy and reaction time scores eliminated ceiling effects that were common when only accuracy information was used. The combined accuracy and reaction time models also distinguished item-level RT into inhibitory control and processing speed components, which are distinct constructs. Results are discussed with respect to the challenges and nuances of the estimation and interpretation of inhibitory control task scores with children of varied ages and ability levels.
format Online
Article
Text
id pubmed-9937058
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-99370582023-02-18 Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children Willoughby, Michael T. Camerota, Marie King, Katherine Merseth Nduku, Tabitha Piper, Benjamin Front Psychol Psychology Preschool-aged children’s performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling effects, which undermine measurement precision. We have previously demonstrated a general approach for scoring inhibitory control tasks that combines item-level accuracy and reaction-time information to minimize ceiling effects. Here, we extend that approach by incorporating additional item-level reaction time data from an adjunct (simple reaction time) task. We contrast three approaches for scoring inhibitory control tasks, two of which rely exclusively on item accuracy information and a third which also considers item reaction time information. We demonstrate the impacts of these different approaches to scoring with two inhibitory control tasks that were included in a recent evaluation of the Red Light, Purple Light intervention in preprimary classrooms in Nairobi County, Kenya. We limited our study to children who met inclusion criteria at pre-test (N = 418; 51% male; mean age = 4.8 years) or post-test (N = 386; 51% male; mean age = 4.8 years). Children’s performance on individual inhibitory control tasks was strongly correlated regardless of the scoring approach (rs = 0.73–0.97 across two tasks). However, the combined accuracy and reaction time scores eliminated ceiling effects that were common when only accuracy information was used. The combined accuracy and reaction time models also distinguished item-level RT into inhibitory control and processing speed components, which are distinct constructs. Results are discussed with respect to the challenges and nuances of the estimation and interpretation of inhibitory control task scores with children of varied ages and ability levels. Frontiers Media S.A. 2023-02-03 /pmc/articles/PMC9937058/ /pubmed/36818066 http://dx.doi.org/10.3389/fpsyg.2023.861441 Text en Copyright © 2023 Willoughby, Camerota, King, Nduku and Piper. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Willoughby, Michael T.
Camerota, Marie
King, Katherine Merseth
Nduku, Tabitha
Piper, Benjamin
Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title_full Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title_fullStr Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title_full_unstemmed Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title_short Leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
title_sort leveraging item-level accuracy and reaction time to address ceiling effects in the measurement of inhibitory control in preschool-aged children
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9937058/
https://www.ncbi.nlm.nih.gov/pubmed/36818066
http://dx.doi.org/10.3389/fpsyg.2023.861441
work_keys_str_mv AT willoughbymichaelt leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren
AT camerotamarie leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren
AT kingkatherinemerseth leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren
AT ndukutabitha leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren
AT piperbenjamin leveragingitemlevelaccuracyandreactiontimetoaddressceilingeffectsinthemeasurementofinhibitorycontrolinpreschoolagedchildren