Cargando…

Analysis Streamlining in ATLAS

We present recent work within the ATLAS collaboration centrally provide tools to facilitate analysis management and highly automated container-based analysis execution in order to both enable non-experts to benefit from these best practices as well as the collaboration to track and re-execute analys...

Descripción completa

Detalles Bibliográficos
Autores principales: Heinrich, Lukas, Costanzo, Davide, Suruliz, Kerim, Krasznahorkay, Attila, Cranmer, Kyle, Kersevan, Borut Paul
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2627651
_version_ 1780959045897682944
author Heinrich, Lukas
Costanzo, Davide
Suruliz, Kerim
Krasznahorkay, Attila
Cranmer, Kyle
Kersevan, Borut Paul
author_facet Heinrich, Lukas
Costanzo, Davide
Suruliz, Kerim
Krasznahorkay, Attila
Cranmer, Kyle
Kersevan, Borut Paul
author_sort Heinrich, Lukas
collection CERN
description We present recent work within the ATLAS collaboration centrally provide tools to facilitate analysis management and highly automated container-based analysis execution in order to both enable non-experts to benefit from these best practices as well as the collaboration to track and re-execute analyses indpendently, e.g. during their review phase. Through integration with the ATLAS GLANCE system, users can request a pre-configured, but customizable version control setup, including continuous integration for automated build and testing as well as continuous Linux Container image building for software preservation purposes. As analyses typically require many individual steps, analysis workflow pipelines can then be defined using such images and the yadage workflow description language. The integration into the workflow exection service REANA allows the interactive or automated reproduction of the main analysis results by orchestrating a large number of container jobs using the Kubernetes. For long-term archival, we present integration with the CERN Analysis Preservation Portal (CAP), where data, analysis repositories, software images and workflows can be stored and indexed for later re-use such as reinterpretations.
id cern-2627651
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26276512019-09-30T06:29:59Zhttp://cds.cern.ch/record/2627651engHeinrich, LukasCostanzo, DavideSuruliz, KerimKrasznahorkay, AttilaCranmer, KyleKersevan, Borut PaulAnalysis Streamlining in ATLASParticle Physics - ExperimentWe present recent work within the ATLAS collaboration centrally provide tools to facilitate analysis management and highly automated container-based analysis execution in order to both enable non-experts to benefit from these best practices as well as the collaboration to track and re-execute analyses indpendently, e.g. during their review phase. Through integration with the ATLAS GLANCE system, users can request a pre-configured, but customizable version control setup, including continuous integration for automated build and testing as well as continuous Linux Container image building for software preservation purposes. As analyses typically require many individual steps, analysis workflow pipelines can then be defined using such images and the yadage workflow description language. The integration into the workflow exection service REANA allows the interactive or automated reproduction of the main analysis results by orchestrating a large number of container jobs using the Kubernetes. For long-term archival, we present integration with the CERN Analysis Preservation Portal (CAP), where data, analysis repositories, software images and workflows can be stored and indexed for later re-use such as reinterpretations.ATL-SOFT-SLIDE-2018-428oai:cds.cern.ch:26276512018-06-30
spellingShingle Particle Physics - Experiment
Heinrich, Lukas
Costanzo, Davide
Suruliz, Kerim
Krasznahorkay, Attila
Cranmer, Kyle
Kersevan, Borut Paul
Analysis Streamlining in ATLAS
title Analysis Streamlining in ATLAS
title_full Analysis Streamlining in ATLAS
title_fullStr Analysis Streamlining in ATLAS
title_full_unstemmed Analysis Streamlining in ATLAS
title_short Analysis Streamlining in ATLAS
title_sort analysis streamlining in atlas
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2627651
work_keys_str_mv AT heinrichlukas analysisstreamlininginatlas
AT costanzodavide analysisstreamlininginatlas
AT surulizkerim analysisstreamlininginatlas
AT krasznahorkayattila analysisstreamlininginatlas
AT cranmerkyle analysisstreamlininginatlas
AT kersevanborutpaul analysisstreamlininginatlas