Cargando…
Strategies for Deploying Unreliable AI Graders in High-Transparency High-Stakes Exams
We describe the deployment of an imperfect NLP-based automatic short answer grading system on an exam in a large-enrollment introductory college course. We characterize this deployment as both high stakes (the questions were on an mid-term exam worth 10% of students’ final grade) and high transparen...
Autores principales: | Azad, Sushmita, Chen, Binglin, Fowler, Maxwell, West, Matthew, Zilles, Craig |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7334190/ http://dx.doi.org/10.1007/978-3-030-52237-7_2 |
Ejemplares similares
-
Designing and validating a scale for evaluating the sources of unreliability of a high-stakes test
por: Nikmard, Fateme, et al.
Publicado: (2023) -
Simulation in a high stakes clinical performance exam
por: Peckler, Brad, et al.
Publicado: (2009) -
What is at stake without high-stakes exams? Students’ evaluation and admission to college at the time of COVID-19()
por: Arenas, Andreu, et al.
Publicado: (2021) -
Appraisal of high-stake examinations during SARS-CoV-2 emergency with responsible and transparent AI: Evidence of fair and detrimental assessment
por: Rayhan, MD., et al.
Publicado: (2022) -
Consistently unreliable: Oil spill data and transparency discourse
por: Watts, Michael, et al.
Publicado: (2020)