Cargando…

The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond

While the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC...

Descripción completa

Detalles Bibliográficos
Autores principales: Perez-Calero Yzquierdo, Antonio Maria, Mascheroni, Marco, Kizinevic, Edita, Khan, Farrukh Aftab, Kim, Hyunwoo, Acosta Flechas, Maria, Tsipinakis, Nikos, Haleem, Saqib
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2872297
_version_ 1780978602343399424
author Perez-Calero Yzquierdo, Antonio Maria
Mascheroni, Marco
Kizinevic, Edita
Khan, Farrukh Aftab
Kim, Hyunwoo
Acosta Flechas, Maria
Tsipinakis, Nikos
Haleem, Saqib
author_facet Perez-Calero Yzquierdo, Antonio Maria
Mascheroni, Marco
Kizinevic, Edita
Khan, Farrukh Aftab
Kim, Hyunwoo
Acosta Flechas, Maria
Tsipinakis, Nikos
Haleem, Saqib
author_sort Perez-Calero Yzquierdo, Antonio Maria
collection CERN
description While the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC Run 3 and the future HL-LHC phase. These facilities often feature diverse compute resources, including alternative CPU architectures like ARM and IBM Power, as well as a variety of GPU specifications. Using these heterogeneous resources efficiently is thus essential for the LHC collaborations reaching their future scientific goals. The Submission Infrastructure (SI) is a central element in CMS Computing, enabling resource acquisition and exploitation by CMS data processing, simulation and analysis tasks. The SI must therefore be adapted to ensure access and optimal utilization of this heterogeneous compute capacity. Some steps in this evolution have been already taken, as CMS is currently using opportunistically a small pool of GPU slots provided mainly at the CMS WLCG sites. Additionally, Power9 processors have been validated for CMS production at the Marconi-100 cluster at CINECA. This note will describe the updated capabilities of the SI to continue ensuring the efficient allocation and use of computing resources by CMS, despite their increasing diversity. The next steps towards a full integration and support of heterogeneous resources according to CMS needs will also be reported.
id cern-2872297
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28722972023-09-25T18:53:33Zhttp://cds.cern.ch/record/2872297engPerez-Calero Yzquierdo, Antonio MariaMascheroni, MarcoKizinevic, EditaKhan, Farrukh AftabKim, HyunwooAcosta Flechas, MariaTsipinakis, NikosHaleem, SaqibThe integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyondDetectors and Experimental TechniquesWhile the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC Run 3 and the future HL-LHC phase. These facilities often feature diverse compute resources, including alternative CPU architectures like ARM and IBM Power, as well as a variety of GPU specifications. Using these heterogeneous resources efficiently is thus essential for the LHC collaborations reaching their future scientific goals. The Submission Infrastructure (SI) is a central element in CMS Computing, enabling resource acquisition and exploitation by CMS data processing, simulation and analysis tasks. The SI must therefore be adapted to ensure access and optimal utilization of this heterogeneous compute capacity. Some steps in this evolution have been already taken, as CMS is currently using opportunistically a small pool of GPU slots provided mainly at the CMS WLCG sites. Additionally, Power9 processors have been validated for CMS production at the Marconi-100 cluster at CINECA. This note will describe the updated capabilities of the SI to continue ensuring the efficient allocation and use of computing resources by CMS, despite their increasing diversity. The next steps towards a full integration and support of heterogeneous resources according to CMS needs will also be reported.CMS-CR-2023-169oai:cds.cern.ch:28722972023-09-20
spellingShingle Detectors and Experimental Techniques
Perez-Calero Yzquierdo, Antonio Maria
Mascheroni, Marco
Kizinevic, Edita
Khan, Farrukh Aftab
Kim, Hyunwoo
Acosta Flechas, Maria
Tsipinakis, Nikos
Haleem, Saqib
The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title_full The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title_fullStr The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title_full_unstemmed The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title_short The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
title_sort integration of heterogeneous resources in the cms submission infrastructure for the lhc run 3 and beyond
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/2872297
work_keys_str_mv AT perezcaleroyzquierdoantoniomaria theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT mascheronimarco theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT kizinevicedita theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT khanfarrukhaftab theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT kimhyunwoo theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT acostaflechasmaria theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT tsipinakisnikos theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT haleemsaqib theintegrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT perezcaleroyzquierdoantoniomaria integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT mascheronimarco integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT kizinevicedita integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT khanfarrukhaftab integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT kimhyunwoo integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT acostaflechasmaria integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT tsipinakisnikos integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond
AT haleemsaqib integrationofheterogeneousresourcesinthecmssubmissioninfrastructureforthelhcrun3andbeyond