Cargando…

A test of the diffusion model explanation for the worst performance rule using preregistration and blinding

People with higher IQ scores also tend to perform better on elementary cognitive-perceptual tasks, such as deciding quickly whether an arrow points to the left or the right Jensen (2006). The worst performance rule (WPR) finesses this relation by stating that the association between IQ and elementar...

Descripción completa

Detalles Bibliográficos
Autores principales: Dutilh, Gilles, Vandekerckhove, Joachim, Ly, Alexander, Matzke, Dora, Pedroni, Andreas, Frey, Renato, Rieskamp, Jörg, Wagenmakers, Eric-Jan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5352774/
https://www.ncbi.nlm.nih.gov/pubmed/28233280
http://dx.doi.org/10.3758/s13414-017-1304-y
_version_ 1782515018740269056
author Dutilh, Gilles
Vandekerckhove, Joachim
Ly, Alexander
Matzke, Dora
Pedroni, Andreas
Frey, Renato
Rieskamp, Jörg
Wagenmakers, Eric-Jan
author_facet Dutilh, Gilles
Vandekerckhove, Joachim
Ly, Alexander
Matzke, Dora
Pedroni, Andreas
Frey, Renato
Rieskamp, Jörg
Wagenmakers, Eric-Jan
author_sort Dutilh, Gilles
collection PubMed
description People with higher IQ scores also tend to perform better on elementary cognitive-perceptual tasks, such as deciding quickly whether an arrow points to the left or the right Jensen (2006). The worst performance rule (WPR) finesses this relation by stating that the association between IQ and elementary-task performance is most pronounced when this performance is summarized by people’s slowest responses. Previous research has shown that the WPR can be accounted for in the Ratcliff diffusion model by assuming that the same ability parameter—drift rate—mediates performance in both elementary tasks and higher-level cognitive tasks. Here we aim to test four qualitative predictions concerning the WPR and its diffusion model explanation in terms of drift rate. In the first stage, the diffusion model was fit to data from 916 participants completing a perceptual two-choice task; crucially, the fitting happened after randomly shuffling the key variable, i.e., each participant’s score on a working memory capacity test. In the second stage, after all modeling decisions were made, the key variable was unshuffled and the adequacy of the predictions was evaluated by means of confirmatory Bayesian hypothesis tests. By temporarily withholding the mapping of the key predictor, we retain flexibility for proper modeling of the data (e.g., outlier exclusion) while preventing biases from unduly influencing the results. Our results provide evidence against the WPR and suggest that it may be less robust and less ubiquitous than is commonly believed.
format Online
Article
Text
id pubmed-5352774
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-53527742017-03-27 A test of the diffusion model explanation for the worst performance rule using preregistration and blinding Dutilh, Gilles Vandekerckhove, Joachim Ly, Alexander Matzke, Dora Pedroni, Andreas Frey, Renato Rieskamp, Jörg Wagenmakers, Eric-Jan Atten Percept Psychophys Registered Reports and Replications People with higher IQ scores also tend to perform better on elementary cognitive-perceptual tasks, such as deciding quickly whether an arrow points to the left or the right Jensen (2006). The worst performance rule (WPR) finesses this relation by stating that the association between IQ and elementary-task performance is most pronounced when this performance is summarized by people’s slowest responses. Previous research has shown that the WPR can be accounted for in the Ratcliff diffusion model by assuming that the same ability parameter—drift rate—mediates performance in both elementary tasks and higher-level cognitive tasks. Here we aim to test four qualitative predictions concerning the WPR and its diffusion model explanation in terms of drift rate. In the first stage, the diffusion model was fit to data from 916 participants completing a perceptual two-choice task; crucially, the fitting happened after randomly shuffling the key variable, i.e., each participant’s score on a working memory capacity test. In the second stage, after all modeling decisions were made, the key variable was unshuffled and the adequacy of the predictions was evaluated by means of confirmatory Bayesian hypothesis tests. By temporarily withholding the mapping of the key predictor, we retain flexibility for proper modeling of the data (e.g., outlier exclusion) while preventing biases from unduly influencing the results. Our results provide evidence against the WPR and suggest that it may be less robust and less ubiquitous than is commonly believed. Springer US 2017-02-23 2017 /pmc/articles/PMC5352774/ /pubmed/28233280 http://dx.doi.org/10.3758/s13414-017-1304-y Text en © The Author(s) 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Registered Reports and Replications
Dutilh, Gilles
Vandekerckhove, Joachim
Ly, Alexander
Matzke, Dora
Pedroni, Andreas
Frey, Renato
Rieskamp, Jörg
Wagenmakers, Eric-Jan
A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title_full A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title_fullStr A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title_full_unstemmed A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title_short A test of the diffusion model explanation for the worst performance rule using preregistration and blinding
title_sort test of the diffusion model explanation for the worst performance rule using preregistration and blinding
topic Registered Reports and Replications
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5352774/
https://www.ncbi.nlm.nih.gov/pubmed/28233280
http://dx.doi.org/10.3758/s13414-017-1304-y
work_keys_str_mv AT dutilhgilles atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT vandekerckhovejoachim atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT lyalexander atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT matzkedora atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT pedroniandreas atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT freyrenato atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT rieskampjorg atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT wagenmakersericjan atestofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT dutilhgilles testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT vandekerckhovejoachim testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT lyalexander testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT matzkedora testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT pedroniandreas testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT freyrenato testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT rieskampjorg testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding
AT wagenmakersericjan testofthediffusionmodelexplanationfortheworstperformanceruleusingpreregistrationandblinding