Cargando…
Mapping global dynamics of benchmark creation and saturation in artificial intelligence
Benchmarks are crucial to measuring and steering progress in artificial intelligence (AI). However, recent studies raised concerns over the state of AI benchmarking, reporting issues such as benchmark overfitting, benchmark saturation and increasing centralization of benchmark dataset creation. To f...
Autores principales: | Ott, Simon, Barbosa-Silva, Adriano, Blagec, Kathrin, Brauner, Jan, Samwald, Matthias |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9649641/ https://www.ncbi.nlm.nih.gov/pubmed/36357391 http://dx.doi.org/10.1038/s41467-022-34591-0 |
Ejemplares similares
-
A curated, ontology-based, large-scale knowledge graph of artificial intelligence tasks and benchmarks
por: Blagec, Kathrin, et al.
Publicado: (2022) -
Fast and scalable neural embedding models for biomedical sentence classification
por: Agibetov, Asan, et al.
Publicado: (2018) -
Neural sentence embedding models for semantic similarity estimation in the biomedical domain
por: Blagec, Kathrin, et al.
Publicado: (2019) -
Examining perceptions of the usefulness and usability of a mobile-based system for pharmacogenomics clinical decision support: a mixed methods study
por: Blagec, Kathrin, et al.
Publicado: (2016) -
An Ontology-Based, Mobile-Optimized System for Pharmacogenomic Decision Support at the Point-of-Care
por: Miñarro-Giménez, Jose Antonio, et al.
Publicado: (2014)