The ATLAS Distributed Data Management project: Past and Future

Mostrar otras versiones (1)

ATLAS has recorded almost 8PB of RAW data since the LHC started running at the end of 2009. Many more derived data products and complimentary simulation data have also been produced by the collaboration and, in total, 90PB is currently stored in the Worldwide LHC Computing Grid by ATLAS. All this da...

Descripción completa

Detalles Bibliográficos
Autores principales: Garonne, V, Graeme, A, Lassnig, M, Molfetas, A, Barisits, M, Beermann, T, Nairz, A, Goossens, L, Barreiro Megino, F, Serfon, C, Oleynik, D, Petrosyan, A
Lenguaje:eng
Publicado: 2012
Materias:
Detectors and Experimental Techniques
Acceso en línea:http://cds.cern.ch/record/1455298
_version_ 1780925040656646144
author Garonne, V
Graeme, A
Lassnig, M
Molfetas, A
Barisits, M
Beermann, T
Nairz, A
Goossens, L
Barreiro Megino, F
Serfon, C
Oleynik, D
Petrosyan, A
author_facet Garonne, V
Graeme, A
Lassnig, M
Molfetas, A
Barisits, M
Beermann, T
Nairz, A
Goossens, L
Barreiro Megino, F
Serfon, C
Oleynik, D
Petrosyan, A
author_sort Garonne, V
collection CERN
description ATLAS has recorded almost 8PB of RAW data since the LHC started running at the end of 2009. Many more derived data products and complimentary simulation data have also been produced by the collaboration and, in total, 90PB is currently stored in the Worldwide LHC Computing Grid by ATLAS. All this data is managed by the ATLAS Distributed Data Management system, called Don Quijote 2 (DQ2). DQ2 has evolved rapidly to help ATLAS Computing operations manage these large quantities of data across the many grid sites at which ATLAS runs, and to help ATLAS physicists get access to this data. In this paper, we describe new and improved DQ2 services, and the experience of data management operation in ATLAS computing, showing how these services enable the management of petabyte scale computing operations. We also present the concepts of the new version of the ATLAS Distributed Data Management (DDM) system, Rucio.
id cern-1455298
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14552982019-09-30T06:29:59Zhttp://cds.cern.ch/record/1455298engGaronne, VGraeme, ALassnig, MMolfetas, ABarisits, MBeermann, TNairz, AGoossens, LBarreiro Megino, FSerfon, COleynik, DPetrosyan, AThe ATLAS Distributed Data Management project: Past and FutureDetectors and Experimental TechniquesATLAS has recorded almost 8PB of RAW data since the LHC started running at the end of 2009. Many more derived data products and complimentary simulation data have also been produced by the collaboration and, in total, 90PB is currently stored in the Worldwide LHC Computing Grid by ATLAS. All this data is managed by the ATLAS Distributed Data Management system, called Don Quijote 2 (DQ2). DQ2 has evolved rapidly to help ATLAS Computing operations manage these large quantities of data across the many grid sites at which ATLAS runs, and to help ATLAS physicists get access to this data. In this paper, we describe new and improved DQ2 services, and the experience of data management operation in ATLAS computing, showing how these services enable the management of petabyte scale computing operations. We also present the concepts of the new version of the ATLAS Distributed Data Management (DDM) system, Rucio.ATL-SOFT-PROC-2012-049oai:cds.cern.ch:14552982012-06-11
spellingShingle Detectors and Experimental Techniques
Garonne, V
Graeme, A
Lassnig, M
Molfetas, A
Barisits, M
Beermann, T
Nairz, A
Goossens, L
Barreiro Megino, F
Serfon, C
Oleynik, D
Petrosyan, A
The ATLAS Distributed Data Management project: Past and Future
title The ATLAS Distributed Data Management project: Past and Future
title_full The ATLAS Distributed Data Management project: Past and Future
title_fullStr The ATLAS Distributed Data Management project: Past and Future
title_full_unstemmed The ATLAS Distributed Data Management project: Past and Future
title_short The ATLAS Distributed Data Management project: Past and Future
title_sort atlas distributed data management project: past and future
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1455298
work_keys_str_mv AT garonnev theatlasdistributeddatamanagementprojectpastandfuture
AT graemea theatlasdistributeddatamanagementprojectpastandfuture
AT lassnigm theatlasdistributeddatamanagementprojectpastandfuture
AT molfetasa theatlasdistributeddatamanagementprojectpastandfuture
AT barisitsm theatlasdistributeddatamanagementprojectpastandfuture
AT beermannt theatlasdistributeddatamanagementprojectpastandfuture
AT nairza theatlasdistributeddatamanagementprojectpastandfuture
AT goossensl theatlasdistributeddatamanagementprojectpastandfuture
AT barreiromeginof theatlasdistributeddatamanagementprojectpastandfuture
AT serfonc theatlasdistributeddatamanagementprojectpastandfuture
AT oleynikd theatlasdistributeddatamanagementprojectpastandfuture
AT petrosyana theatlasdistributeddatamanagementprojectpastandfuture
AT garonnev atlasdistributeddatamanagementprojectpastandfuture
AT graemea atlasdistributeddatamanagementprojectpastandfuture
AT lassnigm atlasdistributeddatamanagementprojectpastandfuture
AT molfetasa atlasdistributeddatamanagementprojectpastandfuture
AT barisitsm atlasdistributeddatamanagementprojectpastandfuture
AT beermannt atlasdistributeddatamanagementprojectpastandfuture
AT nairza atlasdistributeddatamanagementprojectpastandfuture
AT goossensl atlasdistributeddatamanagementprojectpastandfuture
AT barreiromeginof atlasdistributeddatamanagementprojectpastandfuture
AT serfonc atlasdistributeddatamanagementprojectpastandfuture
AT oleynikd atlasdistributeddatamanagementprojectpastandfuture
AT petrosyana atlasdistributeddatamanagementprojectpastandfuture

Ejemplares similares