Cargando…
Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
Benchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a ne...
Autores principales: | , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024507035 http://cds.cern.ch/record/2715453 |
_version_ | 1780965435501445120 |
---|---|
author | Valassi, Andrea Alef, Manfred Barbet, Jean-Michel Datskova, Olga De Maria, Riccardo Medeiros, Miguel Fontes Giordano, Domenico Grigoras, Costin Hollowell, Christopher Javurkova, Martina Khristenko, Viktor Lange, David Michelotto, Michele Rinaldi, Lorenzo Sciabà, Andrea Van Der Laan, Cas |
author_facet | Valassi, Andrea Alef, Manfred Barbet, Jean-Michel Datskova, Olga De Maria, Riccardo Medeiros, Miguel Fontes Giordano, Domenico Grigoras, Costin Hollowell, Christopher Javurkova, Martina Khristenko, Viktor Lange, David Michelotto, Michele Rinaldi, Lorenzo Sciabà, Andrea Van Der Laan, Cas |
author_sort | Valassi, Andrea |
collection | CERN |
description | Benchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a new benchmark suite for WLCG compute resources, based on real applications from the LHC experiments. By construction, these new benchmarks are thus guaranteed to have a score highly correlated to the throughputs of HEP applications, and a CPU usage pattern similar to theirs. Linux containers and the CernVM-FS filesystem are the two main technologies enabling this approach, which had been considered impossible in the past. In this paper, we review the motivation, implementation and outlook of the new benchmark suite. |
id | cern-2715453 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27154532021-12-18T03:11:57Zdoi:10.1051/epjconf/202024507035http://cds.cern.ch/record/2715453engValassi, AndreaAlef, ManfredBarbet, Jean-MichelDatskova, OlgaDe Maria, RiccardoMedeiros, Miguel FontesGiordano, DomenicoGrigoras, CostinHollowell, ChristopherJavurkova, MartinaKhristenko, ViktorLange, DavidMichelotto, MicheleRinaldi, LorenzoSciabà, AndreaVan Der Laan, CasUsing HEP experiment workflows for the benchmarking and accounting of WLCG computing resourcesphysics.ins-detDetectors and Experimental Techniqueshep-exParticle Physics - Experimentcs.PFComputing and ComputersBenchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP workloads. The aim of the HEP-Benchmarks project is to develop a new benchmark suite for WLCG compute resources, based on real applications from the LHC experiments. By construction, these new benchmarks are thus guaranteed to have a score highly correlated to the throughputs of HEP applications, and a CPU usage pattern similar to theirs. Linux containers and the CernVM-FS filesystem are the two main technologies enabling this approach, which had been considered impossible in the past. In this paper, we review the motivation, implementation and outlook of the new benchmark suite.arXiv:2004.01609oai:cds.cern.ch:27154532020 |
spellingShingle | physics.ins-det Detectors and Experimental Techniques hep-ex Particle Physics - Experiment cs.PF Computing and Computers Valassi, Andrea Alef, Manfred Barbet, Jean-Michel Datskova, Olga De Maria, Riccardo Medeiros, Miguel Fontes Giordano, Domenico Grigoras, Costin Hollowell, Christopher Javurkova, Martina Khristenko, Viktor Lange, David Michelotto, Michele Rinaldi, Lorenzo Sciabà, Andrea Van Der Laan, Cas Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title | Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title_full | Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title_fullStr | Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title_full_unstemmed | Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title_short | Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources |
title_sort | using hep experiment workflows for the benchmarking and accounting of wlcg computing resources |
topic | physics.ins-det Detectors and Experimental Techniques hep-ex Particle Physics - Experiment cs.PF Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024507035 http://cds.cern.ch/record/2715453 |
work_keys_str_mv | AT valassiandrea usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT alefmanfred usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT barbetjeanmichel usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT datskovaolga usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT demariariccardo usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT medeirosmiguelfontes usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT giordanodomenico usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT grigorascostin usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT hollowellchristopher usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT javurkovamartina usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT khristenkoviktor usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT langedavid usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT michelottomichele usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT rinaldilorenzo usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT sciabaandrea usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources AT vanderlaancas usinghepexperimentworkflowsforthebenchmarkingandaccountingofwlcgcomputingresources |