Cargando…

Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources

Benchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a ne...

Descripción completa

Detalles Bibliográficos
Autores principales: Valassi, Andrea, Alef, Manfred, Barbet, Jean-Michel, Datskova, Olga, De Maria, Riccardo, Medeiros, Miguel Fontes, Giordano, Domenico, Grigoras, Costin, Hollowell, Christopher, Javurkova, Martina, Khristenko, Viktor, Lange, David, Michelotto, Michele, Rinaldi, Lorenzo, Sciabà, Andrea, Van Der Laan, Cas
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024507035
http://cds.cern.ch/record/2715453
_version_ 1780965435501445120
author Valassi, Andrea
Alef, Manfred
Barbet, Jean-Michel
Datskova, Olga
De Maria, Riccardo
Medeiros, Miguel Fontes
Giordano, Domenico
Grigoras, Costin
Hollowell, Christopher
Javurkova, Martina
Khristenko, Viktor
Lange, David
Michelotto, Michele
Rinaldi, Lorenzo
Sciabà, Andrea
Van Der Laan, Cas
author_facet Valassi, Andrea
Alef, Manfred
Barbet, Jean-Michel
Datskova, Olga
De Maria, Riccardo
Medeiros, Miguel Fontes
Giordano, Domenico
Grigoras, Costin
Hollowell, Christopher
Javurkova, Martina
Khristenko, Viktor
Lange, David
Michelotto, Michele
Rinaldi, Lorenzo
Sciabà, Andrea
Van Der Laan, Cas
author_sort Valassi, Andrea
collection CERN
description Benchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a new benchmark suite for WLCG compute resources, based on real applications from the LHC experiments. By construction, these new benchmarks are thus guaranteed to have a score highly correlated to the throughputs of HEP applications, and a CPU usage pattern similar to theirs. Linux containers and the CernVM-FS filesystem are the two main technologies enabling this approach, which had been considered impossible in the past. In this paper, we review the motivation, implementation and outlook of the new benchmark suite.
id cern-2715453
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27154532021-12-18T03:11:57Zdoi:10.1051/epjconf/202024507035http://cds.cern.ch/record/2715453engValassi, AndreaAlef, ManfredBarbet, Jean-MichelDatskova, OlgaDe Maria, RiccardoMedeiros, Miguel FontesGiordano, DomenicoGrigoras, CostinHollowell, ChristopherJavurkova, MartinaKhristenko, ViktorLange, DavidMichelotto, MicheleRinaldi, LorenzoSciabà, AndreaVan Der Laan, CasUsing HEP experiment workflows for the benchmarking and accounting of WLCG computing resourcesphysics.ins-detDetectors and Experimental Techniqueshep-exParticle Physics - Experimentcs.PFComputing and ComputersBenchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a new benchmark suite for WLCG compute resources, based on real applications from the LHC experiments. By construction, these new benchmarks are thus guaranteed to have a score highly correlated to the throughputs of HEP applications, and a CPU usage pattern similar to theirs. Linux containers and the CernVM-FS filesystem are the two main technologies enabling this approach, which had been considered impossible in the past. In this paper, we review the motivation, implementation and outlook of the new benchmark suite.arXiv:2004.01609oai:cds.cern.ch:27154532020
spellingShingle physics.ins-det
Detectors and Experimental Techniques
hep-ex
Particle Physics - Experiment
cs.PF
Computing and Computers
Valassi, Andrea
Alef, Manfred
Barbet, Jean-Michel
Datskova, Olga
De Maria, Riccardo
Medeiros, Miguel Fontes
Giordano, Domenico
Grigoras, Costin
Hollowell, Christopher
Javurkova, Martina
Khristenko, Viktor
Lange, David
Michelotto, Michele
Rinaldi, Lorenzo
Sciabà, Andrea
Van Der Laan, Cas
Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title_full Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title_fullStr Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title_full_unstemmed Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title_short Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
title_sort using hep experiment workflows for the benchmarking and accounting of wlcg computing resources
topic physics.ins-det
Detectors and Experimental Techniques
hep-ex
Particle Physics - Experiment
cs.PF
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024507035
http://cds.cern.ch/record/2715453
work_keys_str_mv AT valassiandrea usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT alefmanfred usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT barbetjeanmichel usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT datskovaolga usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT demariariccardo usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT medeirosmiguelfontes usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT giordanodomenico usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT grigorascostin usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT hollowellchristopher usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT javurkovamartina usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT khristenkoviktor usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT langedavid usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT michelottomichele usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT rinaldilorenzo usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT sciabaandrea usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources
AT vanderlaancas usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources