Cargando…

The ATLAS Distributed Analysis System

In the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the lar...

Descripción completa

Detalles Bibliográficos
Autores principales: Legger, F, Fassi, F, Pacheco Pages, A, Stradling, A
Lenguaje:eng
Publicado: 2013
Materias:
Acceso en línea:http://cds.cern.ch/record/1609039
_version_ 1780931890619875328
author Legger, F
Fassi, F
Pacheco Pages, A
Stradling, A
author_facet Legger, F
Fassi, F
Pacheco Pages, A
Stradling, A
author_sort Legger, F
collection CERN
description In the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the largest distributed computational resource existing in the sciences. The ATLAS experiment currently stores over 140 PB of data and runs about 140,000 concurrent jobs continuously at WLCG sites. During the first run of the LHC, the ATLAS Distributed Analysis (DA) service has operated stably and scaled as planned. More than 1600 users submitted jobs in 2012, with 2 million or more analysis jobs per week, peaking at about a million jobs per day. The system dynamically distributes popular data to expedite processing and maximally utilize resources. The reliability of the DA service is high but steadily improving; grid sites are continually validated against a set of standard tests, and a dedicated team of expert shifters provides user support and communicates user problems to the sites. Both the user support techniques and the direct feedback of users have been effective in improving the success rate and user experience when utilizing the distributed computing environment. In this contribution a description of the main components, activities and achievements of ATLAS distributed analysis is given. Also several future improvements being undertaken will be described.
id cern-1609039
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16090392019-09-30T06:29:59Zhttp://cds.cern.ch/record/1609039engLegger, FFassi, FPacheco Pages, AStradling, AThe ATLAS Distributed Analysis SystemDetectors and Experimental TechniquesIn the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the largest distributed computational resource existing in the sciences. The ATLAS experiment currently stores over 140 PB of data and runs about 140,000 concurrent jobs continuously at WLCG sites. During the first run of the LHC, the ATLAS Distributed Analysis (DA) service has operated stably and scaled as planned. More than 1600 users submitted jobs in 2012, with 2 million or more analysis jobs per week, peaking at about a million jobs per day. The system dynamically distributes popular data to expedite processing and maximally utilize resources. The reliability of the DA service is high but steadily improving; grid sites are continually validated against a set of standard tests, and a dedicated team of expert shifters provides user support and communicates user problems to the sites. Both the user support techniques and the direct feedback of users have been effective in improving the success rate and user experience when utilizing the distributed computing environment. In this contribution a description of the main components, activities and achievements of ATLAS distributed analysis is given. Also several future improvements being undertaken will be described.ATL-SOFT-SLIDE-2013-826oai:cds.cern.ch:16090392013-10-10
spellingShingle Detectors and Experimental Techniques
Legger, F
Fassi, F
Pacheco Pages, A
Stradling, A
The ATLAS Distributed Analysis System
title The ATLAS Distributed Analysis System
title_full The ATLAS Distributed Analysis System
title_fullStr The ATLAS Distributed Analysis System
title_full_unstemmed The ATLAS Distributed Analysis System
title_short The ATLAS Distributed Analysis System
title_sort atlas distributed analysis system
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1609039
work_keys_str_mv AT leggerf theatlasdistributedanalysissystem
AT fassif theatlasdistributedanalysissystem
AT pachecopagesa theatlasdistributedanalysissystem
AT stradlinga theatlasdistributedanalysissystem
AT leggerf atlasdistributedanalysissystem
AT fassif atlasdistributedanalysissystem
AT pachecopagesa atlasdistributedanalysissystem
AT stradlinga atlasdistributedanalysissystem