Cargando…

Enabling ATLAS big data processing on Piz Daint at CSCS

Predictions for requirements for the LHC computing for Run 3 and Run 4 (HLLHC) over the course of the next 10 years show a considerable gap between required and available resources, assuming budgets will globally remain flat at best. This will require some radical changes to the computing models for...

Descripción completa

Detalles Bibliográficos
Autores principales: Sciacca, Francesco Giovanni, Weber, Michele
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024509005
http://cds.cern.ch/record/2712004
_version_ 1780965265872257024
author Sciacca, Francesco Giovanni
Weber, Michele
author_facet Sciacca, Francesco Giovanni
Weber, Michele
author_sort Sciacca, Francesco Giovanni
collection CERN
description Predictions for requirements for the LHC computing for Run 3 and Run 4 (HLLHC) over the course of the next 10 years show a considerable gap between required and available resources, assuming budgets will globally remain flat at best. This will require some radical changes to the computing models for the data processing of the LHC experiments. Concentrating computational resources in fewer larger and more efficient centres should increase the cost-efficiency of the operation and, thus, of the data processing. Large scale general purpose HPC centres could play a crucial role in such a model. We report on the technical challenges and solutions adopted to enable the processing of the ATLAS experiment data on the European flagship HPC Piz Daint at CSCS, now acting as a pledged WLCG Tier-2 centre. As the transition of the Tier-2 from classic to HPC resources has been finalised, we also report on performance figures over two years of production running and on efforts for a deeper integration of the HPC resource within the ATLAS computing framework at different tiers.
id cern-2712004
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27120042022-10-20T12:32:35Zdoi:10.1051/epjconf/202024509005http://cds.cern.ch/record/2712004engSciacca, Francesco GiovanniWeber, MicheleEnabling ATLAS big data processing on Piz Daint at CSCSParticle Physics - ExperimentComputing and ComputersPredictions for requirements for the LHC computing for Run 3 and Run 4 (HLLHC) over the course of the next 10 years show a considerable gap between required and available resources, assuming budgets will globally remain flat at best. This will require some radical changes to the computing models for the data processing of the LHC experiments. Concentrating computational resources in fewer larger and more efficient centres should increase the cost-efficiency of the operation and, thus, of the data processing. Large scale general purpose HPC centres could play a crucial role in such a model. We report on the technical challenges and solutions adopted to enable the processing of the ATLAS experiment data on the European flagship HPC Piz Daint at CSCS, now acting as a pledged WLCG Tier-2 centre. As the transition of the Tier-2 from classic to HPC resources has been finalised, we also report on performance figures over two years of production running and on efforts for a deeper integration of the HPC resource within the ATLAS computing framework at different tiers.ATL-SOFT-PROC-2020-018oai:cds.cern.ch:27120042020-03-03
spellingShingle Particle Physics - Experiment
Computing and Computers
Sciacca, Francesco Giovanni
Weber, Michele
Enabling ATLAS big data processing on Piz Daint at CSCS
title Enabling ATLAS big data processing on Piz Daint at CSCS
title_full Enabling ATLAS big data processing on Piz Daint at CSCS
title_fullStr Enabling ATLAS big data processing on Piz Daint at CSCS
title_full_unstemmed Enabling ATLAS big data processing on Piz Daint at CSCS
title_short Enabling ATLAS big data processing on Piz Daint at CSCS
title_sort enabling atlas big data processing on piz daint at cscs
topic Particle Physics - Experiment
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024509005
http://cds.cern.ch/record/2712004
work_keys_str_mv AT sciaccafrancescogiovanni enablingatlasbigdataprocessingonpizdaintatcscs
AT webermichele enablingatlasbigdataprocessingonpizdaintatcscs