Cargando…
Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society
The possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithi...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/9/092019 http://cds.cern.ch/record/2017827 |
_version_ | 1780946743905484800 |
---|---|
author | Kennedy, John Kluth, Stefan Mazzaferro, Luca Walker, Rodney |
author_facet | Kennedy, John Kluth, Stefan Mazzaferro, Luca Walker, Rodney |
author_sort | Kennedy, John |
collection | CERN |
description | The possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithic systems, to a more generic Linux type platform. This change means that the deployment of non HPC specific codes has become much easier. The timing of this evolution perfectly suits the needs of ATLAS and opens a new window of opportunity. The ATLAS experiment at CERN will begin a period of high luminosity data taking in 2015. This high luminosity phase will be accompanied by a need for increasing amounts of simulated data which is expected to exceed the capabilities of the current Grid infrastructure. ATLAS aims to address this need by opportunistically accessing resources such as cloud and HPC systems. This paper presents the results of a pilot project undertaken by ATLAS and the MPP and RZG to provide access to the HYDRA supercomputer facility. Hydra is the supercomputer of the Max Planck Society, consists of over 80000 cores and 4000 physical nodes, is located at the RZG near Munich, and uses the Linux OS. This paper describes the work undertaken to integrate Hydra into the ATLAS production system by using the Nordugrid ARC-CE and other standard Grid components. The customization of these components and the strategies for HPC usage are discussed as well as possibilities for future directions. |
id | cern-2017827 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20178272022-08-10T12:57:35Zdoi:10.1088/1742-6596/664/9/092019http://cds.cern.ch/record/2017827engKennedy, JohnKluth, StefanMazzaferro, LucaWalker, RodneyBringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck SocietyParticle Physics - ExperimentThe possible usage of HPC resources by ATLAS is now becoming viable due to the changing nature of these systems and it is also very attractive due to the need for increasing amounts of simulated data. In recent years the architecture of HPC systems has evolved, moving away from specialized monolithic systems, to a more generic Linux type platform. This change means that the deployment of non HPC specific codes has become much easier. The timing of this evolution perfectly suits the needs of ATLAS and opens a new window of opportunity. The ATLAS experiment at CERN will begin a period of high luminosity data taking in 2015. This high luminosity phase will be accompanied by a need for increasing amounts of simulated data which is expected to exceed the capabilities of the current Grid infrastructure. ATLAS aims to address this need by opportunistically accessing resources such as cloud and HPC systems. This paper presents the results of a pilot project undertaken by ATLAS and the MPP and RZG to provide access to the HYDRA supercomputer facility. Hydra is the supercomputer of the Max Planck Society, consists of over 80000 cores and 4000 physical nodes, is located at the RZG near Munich, and uses the Linux OS. This paper describes the work undertaken to integrate Hydra into the ATLAS production system by using the Nordugrid ARC-CE and other standard Grid components. The customization of these components and the strategies for HPC usage are discussed as well as possibilities for future directions.ATL-SOFT-PROC-2015-055oai:cds.cern.ch:20178272015-05-22 |
spellingShingle | Particle Physics - Experiment Kennedy, John Kluth, Stefan Mazzaferro, Luca Walker, Rodney Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title | Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title_full | Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title_fullStr | Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title_full_unstemmed | Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title_short | Bringing ATLAS production to HPC resources - A use case with the Hydra supercomputer of the Max Planck Society |
title_sort | bringing atlas production to hpc resources - a use case with the hydra supercomputer of the max planck society |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1088/1742-6596/664/9/092019 http://cds.cern.ch/record/2017827 |
work_keys_str_mv | AT kennedyjohn bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety AT kluthstefan bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety AT mazzaferroluca bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety AT walkerrodney bringingatlasproductiontohpcresourcesausecasewiththehydrasupercomputerofthemaxplancksociety |