Cargando…

Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study

Interrupted time series (ITS) analysis is being increasingly used in epidemiology. Despite its growing popularity, there is a scarcity of guidance on power and sample size considerations within the ITS framework. Our aim of this study was to assess the statistical power to detect an intervention eff...

Descripción completa

Detalles Bibliográficos
Autores principales: Hawley, Samuel, Ali, M Sanni, Berencsi, Klara, Judge, Andrew, Prieto-Alhambra, Daniel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Dove Medical Press 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6394245/
https://www.ncbi.nlm.nih.gov/pubmed/30881136
http://dx.doi.org/10.2147/CLEP.S176723
_version_ 1783398853862490112
author Hawley, Samuel
Ali, M Sanni
Berencsi, Klara
Judge, Andrew
Prieto-Alhambra, Daniel
author_facet Hawley, Samuel
Ali, M Sanni
Berencsi, Klara
Judge, Andrew
Prieto-Alhambra, Daniel
author_sort Hawley, Samuel
collection PubMed
description Interrupted time series (ITS) analysis is being increasingly used in epidemiology. Despite its growing popularity, there is a scarcity of guidance on power and sample size considerations within the ITS framework. Our aim of this study was to assess the statistical power to detect an intervention effect under various real-life ITS scenarios. ITS datasets were created using Monte Carlo simulations to generate cumulative incidence (outcome) values over time. We generated 1,000 datasets per scenario, varying the number of time points, average sample size per time point, average relative reduction post intervention, location of intervention in the time series, and reduction mediated via a 1) slope change and 2) step change. Performance measures included power and percentage bias. We found that sample size per time point had a large impact on power. Even in scenarios with 12 pre-intervention and 12 post-intervention time points with moderate intervention effect sizes, most analyses were underpowered if the sample size per time point was low. We conclude that various factors need to be collectively considered to ensure adequate power for an ITS study. We demonstrate a means of providing insight into underlying sample size requirements in ordinary least squares (OLS) ITS analysis of cumulative incidence measures, based on prespecified parameters and have developed Stata code to estimate this.
format Online
Article
Text
id pubmed-6394245
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Dove Medical Press
record_format MEDLINE/PubMed
spelling pubmed-63942452019-03-15 Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study Hawley, Samuel Ali, M Sanni Berencsi, Klara Judge, Andrew Prieto-Alhambra, Daniel Clin Epidemiol Methodology Interrupted time series (ITS) analysis is being increasingly used in epidemiology. Despite its growing popularity, there is a scarcity of guidance on power and sample size considerations within the ITS framework. Our aim of this study was to assess the statistical power to detect an intervention effect under various real-life ITS scenarios. ITS datasets were created using Monte Carlo simulations to generate cumulative incidence (outcome) values over time. We generated 1,000 datasets per scenario, varying the number of time points, average sample size per time point, average relative reduction post intervention, location of intervention in the time series, and reduction mediated via a 1) slope change and 2) step change. Performance measures included power and percentage bias. We found that sample size per time point had a large impact on power. Even in scenarios with 12 pre-intervention and 12 post-intervention time points with moderate intervention effect sizes, most analyses were underpowered if the sample size per time point was low. We conclude that various factors need to be collectively considered to ensure adequate power for an ITS study. We demonstrate a means of providing insight into underlying sample size requirements in ordinary least squares (OLS) ITS analysis of cumulative incidence measures, based on prespecified parameters and have developed Stata code to estimate this. Dove Medical Press 2019-02-25 /pmc/articles/PMC6394245/ /pubmed/30881136 http://dx.doi.org/10.2147/CLEP.S176723 Text en © 2019 Hawley et al. This work is published and licensed by Dove Medical Press Limited The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution – Non Commercial (unported, v3.0) License (http://creativecommons.org/licenses/by-nc/3.0/). By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed.
spellingShingle Methodology
Hawley, Samuel
Ali, M Sanni
Berencsi, Klara
Judge, Andrew
Prieto-Alhambra, Daniel
Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title_full Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title_fullStr Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title_full_unstemmed Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title_short Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
title_sort sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study
topic Methodology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6394245/
https://www.ncbi.nlm.nih.gov/pubmed/30881136
http://dx.doi.org/10.2147/CLEP.S176723
work_keys_str_mv AT hawleysamuel samplesizeandpowerconsiderationsforordinaryleastsquaresinterruptedtimeseriesanalysisasimulationstudy
AT alimsanni samplesizeandpowerconsiderationsforordinaryleastsquaresinterruptedtimeseriesanalysisasimulationstudy
AT berencsiklara samplesizeandpowerconsiderationsforordinaryleastsquaresinterruptedtimeseriesanalysisasimulationstudy
AT judgeandrew samplesizeandpowerconsiderationsforordinaryleastsquaresinterruptedtimeseriesanalysisasimulationstudy
AT prietoalhambradaniel samplesizeandpowerconsiderationsforordinaryleastsquaresinterruptedtimeseriesanalysisasimulationstudy