Cargando…

Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society

The possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithi...

Descripción completa

Detalles Bibliográficos
Autores principales: Kennedy, John, Kluth, Stefan, Mazzaferro, Luca, Walker, Rodney
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/9/092019
http://cds.cern.ch/record/2017827
_version_ 1780946743905484800
author Kennedy, John
Kluth, Stefan
Mazzaferro, Luca
Walker, Rodney
author_facet Kennedy, John
Kluth, Stefan
Mazzaferro, Luca
Walker, Rodney
author_sort Kennedy, John
collection CERN
description The possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithic systems, to a more generic Linux type platform. This change means that the deployment of non HPC specific codes has become much easier. The timing of this evolution perfectly suits the needs of ATLAS and opens a new window of opportunity. The ATLAS experiment at CERN will begin a period of high luminosity data taking in 2015. This high luminosity phase will be accompanied by a need for increasing amounts of simulated data which is expected to exceed the capabilities of the current Grid infrastructure. ATLAS aims to address this need by opportunistically accessing resources such as cloud and HPC systems. This paper presents the results of a pilot project undertaken by ATLAS and the MPP and RZG to provide access to the HYDRA supercomputer facility. Hydra is the supercomputer of the Max Planck Society, consists of over 80000 cores and 4000 physical nodes, is located at the RZG near Munich, and uses the Linux OS. This paper describes the work undertaken to integrate Hydra into the ATLAS production system by using the Nordugrid ARC-CE and other standard Grid components. The customization of these components and the strategies for HPC usage are discussed as well as possibilities for future directions.
id cern-2017827
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20178272022-08-10T12:57:35Zdoi:10.1088/1742-6596/664/9/092019http://cds.cern.ch/record/2017827engKennedy, JohnKluth, StefanMazzaferro, LucaWalker, RodneyBringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck SocietyParticle Physics - ExperimentThe possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithic systems, to a more generic Linux type platform. This change means that the deployment of non HPC specific codes has become much easier. The timing of this evolution perfectly suits the needs of ATLAS and opens a new window of opportunity. The ATLAS experiment at CERN will begin a period of high luminosity data taking in 2015. This high luminosity phase will be accompanied by a need for increasing amounts of simulated data which is expected to exceed the capabilities of the current Grid infrastructure. ATLAS aims to address this need by opportunistically accessing resources such as cloud and HPC systems. This paper presents the results of a pilot project undertaken by ATLAS and the MPP and RZG to provide access to the HYDRA supercomputer facility. Hydra is the supercomputer of the Max Planck Society, consists of over 80000 cores and 4000 physical nodes, is located at the RZG near Munich, and uses the Linux OS. This paper describes the work undertaken to integrate Hydra into the ATLAS production system by using the Nordugrid ARC-CE and other standard Grid components. The customization of these components and the strategies for HPC usage are discussed as well as possibilities for future directions.ATL-SOFT-PROC-2015-055oai:cds.cern.ch:20178272015-05-22
spellingShingle Particle Physics - Experiment
Kennedy, John
Kluth, Stefan
Mazzaferro, Luca
Walker, Rodney
Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title_full Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title_fullStr Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title_full_unstemmed Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title_short Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
title_sort bringing atlas production to hpc resources - a use case with the hydra supercomputer of the max planck society
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/664/9/092019
http://cds.cern.ch/record/2017827
work_keys_str_mv AT kennedyjohn bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety
AT kluthstefan bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety
AT mazzaferroluca bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety
AT walkerrodney bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety