Cargando…

Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention

In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation’s validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The...

Descripción completa

Detalles Bibliográficos
Autores principales: Persic-Beck, Lothar, Goldhammer, Frank, Kroehne, Ulf
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9669795/
https://www.ncbi.nlm.nih.gov/pubmed/36405144
http://dx.doi.org/10.3389/fpsyg.2022.954532
_version_ 1784832200792866816
author Persic-Beck, Lothar
Goldhammer, Frank
Kroehne, Ulf
author_facet Persic-Beck, Lothar
Goldhammer, Frank
Kroehne, Ulf
author_sort Persic-Beck, Lothar
collection PubMed
description In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation’s validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The blocked response was implemented to prevent participants from accidental navigation and as a naive attempt to prevent rapid guesses and rapid omissions. The response process was analyzed by interpreting log event sequences within a finite-state machine approach. Responses were assigned to different response classes based on the event sequence. Additionally, post hoc methods for detecting rapid responses based on response time thresholds were applied to validate the classification. Rapid guesses and rapid omissions could be distinguished from accidental clicks by the log events following the micro-intervention. Results showed that the blocked response interfered with rapid responses but hardly led to behavioral changes. However, the blocked response could improve the post hoc detection of rapid responding by identifying responses that narrowly exceed time-bound thresholds. In an assessment context, it is desirable to prevent participants from accidentally skipping items, which in itself may lead to an increasing popularity of initially blocking responses. If, however, data from those assessments is analyzed for rapid responses, additional log data information should be considered.
format Online
Article
Text
id pubmed-9669795
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-96697952022-11-18 Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention Persic-Beck, Lothar Goldhammer, Frank Kroehne, Ulf Front Psychol Psychology In large-scale assessments, disengaged participants might rapidly guess on items or skip items, which can affect the score interpretation’s validity. This study analyzes data from a linear computer-based assessment to evaluate a micro-intervention that blocked the possibility to respond for 2 s. The blocked response was implemented to prevent participants from accidental navigation and as a naive attempt to prevent rapid guesses and rapid omissions. The response process was analyzed by interpreting log event sequences within a finite-state machine approach. Responses were assigned to different response classes based on the event sequence. Additionally, post hoc methods for detecting rapid responses based on response time thresholds were applied to validate the classification. Rapid guesses and rapid omissions could be distinguished from accidental clicks by the log events following the micro-intervention. Results showed that the blocked response interfered with rapid responses but hardly led to behavioral changes. However, the blocked response could improve the post hoc detection of rapid responding by identifying responses that narrowly exceed time-bound thresholds. In an assessment context, it is desirable to prevent participants from accidentally skipping items, which in itself may lead to an increasing popularity of initially blocking responses. If, however, data from those assessments is analyzed for rapid responses, additional log data information should be considered. Frontiers Media S.A. 2022-11-03 /pmc/articles/PMC9669795/ /pubmed/36405144 http://dx.doi.org/10.3389/fpsyg.2022.954532 Text en Copyright © 2022 Persic-Beck, Goldhammer and Kroehne. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Persic-Beck, Lothar
Goldhammer, Frank
Kroehne, Ulf
Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title_full Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title_fullStr Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title_full_unstemmed Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title_short Disengaged response behavior when the response button is blocked: Evaluation of a micro-intervention
title_sort disengaged response behavior when the response button is blocked: evaluation of a micro-intervention
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9669795/
https://www.ncbi.nlm.nih.gov/pubmed/36405144
http://dx.doi.org/10.3389/fpsyg.2022.954532
work_keys_str_mv AT persicbecklothar disengagedresponsebehaviorwhentheresponsebuttonisblockedevaluationofamicrointervention
AT goldhammerfrank disengagedresponsebehaviorwhentheresponsebuttonisblockedevaluationofamicrointervention
AT kroehneulf disengagedresponsebehaviorwhentheresponsebuttonisblockedevaluationofamicrointervention