Cargando…

Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research

Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta‐analyses on language development between birth and 5 years. Wi...

Descripción completa

Detalles Bibliográficos
Autores principales: Bergmann, Christina, Tsuji, Sho, Piccinini, Page E., Lewis, Molly L., Braginsky, Mika, Frank, Michael C., Cristia, Alejandrina
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6282795/
https://www.ncbi.nlm.nih.gov/pubmed/29736962
http://dx.doi.org/10.1111/cdev.13079
_version_ 1783379067819524096
author Bergmann, Christina
Tsuji, Sho
Piccinini, Page E.
Lewis, Molly L.
Braginsky, Mika
Frank, Michael C.
Cristia, Alejandrina
author_facet Bergmann, Christina
Tsuji, Sho
Piccinini, Page E.
Lewis, Molly L.
Braginsky, Mika
Frank, Michael C.
Cristia, Alejandrina
author_sort Bergmann, Christina
collection PubMed
description Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta‐analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%–99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.
format Online
Article
Text
id pubmed-6282795
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-62827952018-12-11 Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research Bergmann, Christina Tsuji, Sho Piccinini, Page E. Lewis, Molly L. Braginsky, Mika Frank, Michael C. Cristia, Alejandrina Child Dev Special Section: Meta‐analysis and Individual Participant Data Synthesis in Child Development Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta‐analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%–99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally. John Wiley and Sons Inc. 2018-05-07 2018 /pmc/articles/PMC6282795/ /pubmed/29736962 http://dx.doi.org/10.1111/cdev.13079 Text en © 2018 The Authors. Child Development published by Wiley Periodicals, Inc. on behalf of Society for Research in Child Development This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.
spellingShingle Special Section: Meta‐analysis and Individual Participant Data Synthesis in Child Development
Bergmann, Christina
Tsuji, Sho
Piccinini, Page E.
Lewis, Molly L.
Braginsky, Mika
Frank, Michael C.
Cristia, Alejandrina
Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title_full Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title_fullStr Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title_full_unstemmed Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title_short Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research
title_sort promoting replicability in developmental research through meta‐analyses: insights from language acquisition research
topic Special Section: Meta‐analysis and Individual Participant Data Synthesis in Child Development
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6282795/
https://www.ncbi.nlm.nih.gov/pubmed/29736962
http://dx.doi.org/10.1111/cdev.13079
work_keys_str_mv AT bergmannchristina promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT tsujisho promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT piccininipagee promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT lewismollyl promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT braginskymika promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT frankmichaelc promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch
AT cristiaalejandrina promotingreplicabilityindevelopmentalresearchthroughmetaanalysesinsightsfromlanguageacquisitionresearch