Mapping global dynamics of benchmark creation and saturation in artificial intelligence

Benchmarks are crucial to measuring and steering progress in artificial intelligence (AI). However, recent studies raised concerns over the state of AI benchmarking, reporting issues such as benchmark overfitting, benchmark saturation and increasing centralization of benchmark dataset creation. To f...

Descripción completa

Detalles Bibliográficos
Autores principales: Ott, Simon, Barbosa-Silva, Adriano, Blagec, Kathrin, Brauner, Jan, Samwald, Matthias
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Article
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9649641/
https://www.ncbi.nlm.nih.gov/pubmed/36357391
http://dx.doi.org/10.1038/s41467-022-34591-0

Internet

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9649641/
https://www.ncbi.nlm.nih.gov/pubmed/36357391
http://dx.doi.org/10.1038/s41467-022-34591-0

Ejemplares similares