Cargando…
The ATLAS Distributed Analysis System
In the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the lar...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2013
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1609039 |
_version_ | 1780931890619875328 |
---|---|
author | Legger, F Fassi, F Pacheco Pages, A Stradling, A |
author_facet | Legger, F Fassi, F Pacheco Pages, A Stradling, A |
author_sort | Legger, F |
collection | CERN |
description | In the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the largest distributed computational resource existing in the sciences. The ATLAS experiment currently stores over 140 PB of data and runs about 140,000 concurrent jobs continuously at WLCG sites. During the first run of the LHC, the ATLAS Distributed Analysis (DA) service has operated stably and scaled as planned. More than 1600 users submitted jobs in 2012, with 2 million or more analysis jobs per week, peaking at about a million jobs per day. The system dynamically distributes popular data to expedite processing and maximally utilize resources. The reliability of the DA service is high but steadily improving; grid sites are continually validated against a set of standard tests, and a dedicated team of expert shifters provides user support and communicates user problems to the sites. Both the user support techniques and the direct feedback of users have been effective in improving the success rate and user experience when utilizing the distributed computing environment. In this contribution a description of the main components, activities and achievements of ATLAS distributed analysis is given. Also several future improvements being undertaken will be described. |
id | cern-1609039 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2013 |
record_format | invenio |
spelling | cern-16090392019-09-30T06:29:59Zhttp://cds.cern.ch/record/1609039engLegger, FFassi, FPacheco Pages, AStradling, AThe ATLAS Distributed Analysis SystemDetectors and Experimental TechniquesIn the LHC operations era, analysis of the multi-petabyte ATLAS data sample by globally distributed physicists is a challenging task. To attain the required scale the ATLAS Computing Model was designed around the concept of grid computing, realized in the Worldwide LHC Computing Grid (WLCG), the largest distributed computational resource existing in the sciences. The ATLAS experiment currently stores over 140 PB of data and runs about 140,000 concurrent jobs continuously at WLCG sites. During the first run of the LHC, the ATLAS Distributed Analysis (DA) service has operated stably and scaled as planned. More than 1600 users submitted jobs in 2012, with 2 million or more analysis jobs per week, peaking at about a million jobs per day. The system dynamically distributes popular data to expedite processing and maximally utilize resources. The reliability of the DA service is high but steadily improving; grid sites are continually validated against a set of standard tests, and a dedicated team of expert shifters provides user support and communicates user problems to the sites. Both the user support techniques and the direct feedback of users have been effective in improving the success rate and user experience when utilizing the distributed computing environment. In this contribution a description of the main components, activities and achievements of ATLAS distributed analysis is given. Also several future improvements being undertaken will be described.ATL-SOFT-SLIDE-2013-826oai:cds.cern.ch:16090392013-10-10 |
spellingShingle | Detectors and Experimental Techniques Legger, F Fassi, F Pacheco Pages, A Stradling, A The ATLAS Distributed Analysis System |
title | The ATLAS Distributed Analysis System |
title_full | The ATLAS Distributed Analysis System |
title_fullStr | The ATLAS Distributed Analysis System |
title_full_unstemmed | The ATLAS Distributed Analysis System |
title_short | The ATLAS Distributed Analysis System |
title_sort | atlas distributed analysis system |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1609039 |
work_keys_str_mv | AT leggerf theatlasdistributedanalysissystem AT fassif theatlasdistributedanalysissystem AT pachecopagesa theatlasdistributedanalysissystem AT stradlinga theatlasdistributedanalysissystem AT leggerf atlasdistributedanalysissystem AT fassif atlasdistributedanalysissystem AT pachecopagesa atlasdistributedanalysissystem AT stradlinga atlasdistributedanalysissystem |