Cargando…

“The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter

In August 2020, the UK government and regulation body Ofqual replaced school examinations with automatically computed A Level grades in England and Wales. This algorithm factored in school attainment in each subject over the previous three years. Government officials initially stated that the algori...

Descripción completa

Detalles Bibliográficos
Autores principales: Heaton, Dan, Nichele, Elena, Clos, Jeremie, Fischer, Joel E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10370707/
https://www.ncbi.nlm.nih.gov/pubmed/37494323
http://dx.doi.org/10.1371/journal.pone.0288662
_version_ 1785077994571694080
author Heaton, Dan
Nichele, Elena
Clos, Jeremie
Fischer, Joel E.
author_facet Heaton, Dan
Nichele, Elena
Clos, Jeremie
Fischer, Joel E.
author_sort Heaton, Dan
collection PubMed
description In August 2020, the UK government and regulation body Ofqual replaced school examinations with automatically computed A Level grades in England and Wales. This algorithm factored in school attainment in each subject over the previous three years. Government officials initially stated that the algorithm was used to combat grade inflation. After public outcry, teacher assessment grades used instead. Views concerning who was to blame for this scandal were expressed on the social media website Twitter. While previous work used NLP-based opinion mining computational linguistic tools to analyse this discourse, shortcomings included accuracy issues, difficulties in interpretation and limited conclusions on who authors blamed. Thus, we chose to complement this research by analysing 18,239 tweets relating to the A Level algorithm using Corpus Linguistics (CL) and Critical Discourse Analysis (CDA), underpinned by social actor representation. We examined how blame was attributed to different entities who were presented as social actors or having social agency. Through analysing transitivity in this discourse, we found the algorithm itself, the UK government and Ofqual were all implicated as potentially responsible as social actors through active agency, agency metaphor possession and instances of passive constructions. According to our results, students were found to have limited blame through the same analysis. We discuss how this builds upon existing research where the algorithm is implicated and how such a wide range of constructions obscure blame. Methodologically, we demonstrated that CL and CDA complement existing NLP-based computational linguistic tools in researching the 2020 A Level algorithm; however, there is further scope for how these approaches can be used in an iterative manner.
format Online
Article
Text
id pubmed-10370707
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-103707072023-07-27 “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter Heaton, Dan Nichele, Elena Clos, Jeremie Fischer, Joel E. PLoS One Research Article In August 2020, the UK government and regulation body Ofqual replaced school examinations with automatically computed A Level grades in England and Wales. This algorithm factored in school attainment in each subject over the previous three years. Government officials initially stated that the algorithm was used to combat grade inflation. After public outcry, teacher assessment grades used instead. Views concerning who was to blame for this scandal were expressed on the social media website Twitter. While previous work used NLP-based opinion mining computational linguistic tools to analyse this discourse, shortcomings included accuracy issues, difficulties in interpretation and limited conclusions on who authors blamed. Thus, we chose to complement this research by analysing 18,239 tweets relating to the A Level algorithm using Corpus Linguistics (CL) and Critical Discourse Analysis (CDA), underpinned by social actor representation. We examined how blame was attributed to different entities who were presented as social actors or having social agency. Through analysing transitivity in this discourse, we found the algorithm itself, the UK government and Ofqual were all implicated as potentially responsible as social actors through active agency, agency metaphor possession and instances of passive constructions. According to our results, students were found to have limited blame through the same analysis. We discuss how this builds upon existing research where the algorithm is implicated and how such a wide range of constructions obscure blame. Methodologically, we demonstrated that CL and CDA complement existing NLP-based computational linguistic tools in researching the 2020 A Level algorithm; however, there is further scope for how these approaches can be used in an iterative manner. Public Library of Science 2023-07-26 /pmc/articles/PMC10370707/ /pubmed/37494323 http://dx.doi.org/10.1371/journal.pone.0288662 Text en © 2023 Heaton et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Heaton, Dan
Nichele, Elena
Clos, Jeremie
Fischer, Joel E.
“The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title_full “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title_fullStr “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title_full_unstemmed “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title_short “The algorithm will screw you”: Blame, social actors and the 2020 A Level results algorithm on Twitter
title_sort “the algorithm will screw you”: blame, social actors and the 2020 a level results algorithm on twitter
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10370707/
https://www.ncbi.nlm.nih.gov/pubmed/37494323
http://dx.doi.org/10.1371/journal.pone.0288662
work_keys_str_mv AT heatondan thealgorithmwillscrewyoublamesocialactorsandthe2020alevelresultsalgorithmontwitter
AT nicheleelena thealgorithmwillscrewyoublamesocialactorsandthe2020alevelresultsalgorithmontwitter
AT closjeremie thealgorithmwillscrewyoublamesocialactorsandthe2020alevelresultsalgorithmontwitter
AT fischerjoele thealgorithmwillscrewyoublamesocialactorsandthe2020alevelresultsalgorithmontwitter