Cargando…
A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19
School performance measures are published annually in England to hold schools to account and to support parental school choice. This article reviews and evaluates the ‘Progress 8’ secondary school accountability system for state‐funded schools. We assess the statistical strengths and weaknesses of P...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8661617/ http://dx.doi.org/10.1002/rev3.3299 |
_version_ | 1784613383900758016 |
---|---|
author | Prior, Lucy Jerrim, John Thomson, Dave Leckie, George |
author_facet | Prior, Lucy Jerrim, John Thomson, Dave Leckie, George |
author_sort | Prior, Lucy |
collection | PubMed |
description | School performance measures are published annually in England to hold schools to account and to support parental school choice. This article reviews and evaluates the ‘Progress 8’ secondary school accountability system for state‐funded schools. We assess the statistical strengths and weaknesses of Progress 8 relating to: choice of pupil outcome attainment measure; potential adjustments for pupil input attainment and background characteristics; decisions around which schools and pupils are excluded from the measure; presentation of Progress 8 to users, choice of statistical model, and calculation of statistical uncertainty; and issues related to the volatility of school performance over time, including scope for reporting multi‐year averages. We then discuss challenges for Progress 8 raised by the COVID‐19 pandemic. Six simple recommendations follow to improve Progress 8 and school accountability in England. CONTEXT AND IMPLICATION: RATIONALE FOR THIS STUDY: This study fulfils a need for a comprehensive statistical evaluation of the Progress 8 school accountability system in England, which has been in place since 2016. WHY THE NEW FINDINGS MATTER: A review of Progress 8 is an important contribution as decisions on its calculation and presentation have important consequences for schools and pupils. IMPLICATIONS FOR EDUCATIONAL RESEARCHERS AND POLICY MAKERS: Our findings on the statistical strengths and weaknesses of Progress 8 and the resulting recommendations made for improvements to the measure and school accountability have clear implications for informing policy makers in the educational system. This includes wider lessons extending beyond Progress 8 to other performance metrics and to other school systems internationally where similar issues apply. Additionally, the review highlights key concerns that the public and school practitioners may like to consider when drawing upon Progress 8 to make decisions around school choice and in assessing how well a school is performing. |
format | Online Article Text |
id | pubmed-8661617 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-86616172021-12-10 A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 Prior, Lucy Jerrim, John Thomson, Dave Leckie, George Review of Education State‐of‐the‐art Review School performance measures are published annually in England to hold schools to account and to support parental school choice. This article reviews and evaluates the ‘Progress 8’ secondary school accountability system for state‐funded schools. We assess the statistical strengths and weaknesses of Progress 8 relating to: choice of pupil outcome attainment measure; potential adjustments for pupil input attainment and background characteristics; decisions around which schools and pupils are excluded from the measure; presentation of Progress 8 to users, choice of statistical model, and calculation of statistical uncertainty; and issues related to the volatility of school performance over time, including scope for reporting multi‐year averages. We then discuss challenges for Progress 8 raised by the COVID‐19 pandemic. Six simple recommendations follow to improve Progress 8 and school accountability in England. CONTEXT AND IMPLICATION: RATIONALE FOR THIS STUDY: This study fulfils a need for a comprehensive statistical evaluation of the Progress 8 school accountability system in England, which has been in place since 2016. WHY THE NEW FINDINGS MATTER: A review of Progress 8 is an important contribution as decisions on its calculation and presentation have important consequences for schools and pupils. IMPLICATIONS FOR EDUCATIONAL RESEARCHERS AND POLICY MAKERS: Our findings on the statistical strengths and weaknesses of Progress 8 and the resulting recommendations made for improvements to the measure and school accountability have clear implications for informing policy makers in the educational system. This includes wider lessons extending beyond Progress 8 to other performance metrics and to other school systems internationally where similar issues apply. Additionally, the review highlights key concerns that the public and school practitioners may like to consider when drawing upon Progress 8 to make decisions around school choice and in assessing how well a school is performing. John Wiley and Sons Inc. 2021-08-27 2021-10 /pmc/articles/PMC8661617/ http://dx.doi.org/10.1002/rev3.3299 Text en © 2021 The Authors. Review of Education published by John Wiley & Sons Ltd on behalf of British Educational Research Association https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | State‐of‐the‐art Review Prior, Lucy Jerrim, John Thomson, Dave Leckie, George A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title | A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title_full | A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title_fullStr | A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title_full_unstemmed | A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title_short | A review and evaluation of secondary school accountability in England: Statistical strengths, weaknesses and challenges for ‘Progress 8’ raised by COVID‐19 |
title_sort | review and evaluation of secondary school accountability in england: statistical strengths, weaknesses and challenges for ‘progress 8’ raised by covid‐19 |
topic | State‐of‐the‐art Review |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8661617/ http://dx.doi.org/10.1002/rev3.3299 |
work_keys_str_mv | AT priorlucy areviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT jerrimjohn areviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT thomsondave areviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT leckiegeorge areviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT priorlucy reviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT jerrimjohn reviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT thomsondave reviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 AT leckiegeorge reviewandevaluationofsecondaryschoolaccountabilityinenglandstatisticalstrengthsweaknessesandchallengesforprogress8raisedbycovid19 |