Cargando…

The ATLAS Distributed Data Management project: Past and Future

<!--HTML-->The ATLAS collaboration has recorded almost 5PB of RAW data since the LHC started running at the end of 2009. Together with experimental data generated from RAW and complimentary simulation data, and accounting for data replicas on the grid, a total of 74TB is currently stored in th...

Descripción completa

Detalles Bibliográficos
Autor principal: Garonne, Vincent
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1460548
_version_ 1780925235817611264
author Garonne, Vincent
author_facet Garonne, Vincent
author_sort Garonne, Vincent
collection CERN
description <!--HTML-->The ATLAS collaboration has recorded almost 5PB of RAW data since the LHC started running at the end of 2009. Together with experimental data generated from RAW and complimentary simulation data, and accounting for data replicas on the grid, a total of 74TB is currently stored in the Worldwide LHC Computing Grid by ATLAS. All of this data is managed by the ATLAS Distributed Data Management system, called Don Quixote 2 (DQ2). The DQ2 system has over time rapidly evolved to assist the ATLAS collaboration management to properly manage the data, as well as provide an effective interface allowing physicists easy access to this data. Numerous new requirements and operational experience of ATLAS' use cases have necessitated the need for a next generation data management system, called Rucio, which will re-engineer the current system to cover new high-level use cases and workflows such as the management of data for physics groups. In this talk, we will describe the state of the current of DQ2, and present an overview of the upcoming Rucio system, covering it's architecture, new innovative features, and preliminary benchmarks.
id cern-1460548
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14605482022-11-02T22:23:46Zhttp://cds.cern.ch/record/1460548engGaronne, VincentThe ATLAS Distributed Data Management project: Past and FutureComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->The ATLAS collaboration has recorded almost 5PB of RAW data since the LHC started running at the end of 2009. Together with experimental data generated from RAW and complimentary simulation data, and accounting for data replicas on the grid, a total of 74TB is currently stored in the Worldwide LHC Computing Grid by ATLAS. All of this data is managed by the ATLAS Distributed Data Management system, called Don Quixote 2 (DQ2). The DQ2 system has over time rapidly evolved to assist the ATLAS collaboration management to properly manage the data, as well as provide an effective interface allowing physicists easy access to this data. Numerous new requirements and operational experience of ATLAS' use cases have necessitated the need for a next generation data management system, called Rucio, which will re-engineer the current system to cover new high-level use cases and workflows such as the management of data for physics groups. In this talk, we will describe the state of the current of DQ2, and present an overview of the upcoming Rucio system, covering it's architecture, new innovative features, and preliminary benchmarks.oai:cds.cern.ch:14605482012
spellingShingle Conferences
Garonne, Vincent
The ATLAS Distributed Data Management project: Past and Future
title The ATLAS Distributed Data Management project: Past and Future
title_full The ATLAS Distributed Data Management project: Past and Future
title_fullStr The ATLAS Distributed Data Management project: Past and Future
title_full_unstemmed The ATLAS Distributed Data Management project: Past and Future
title_short The ATLAS Distributed Data Management project: Past and Future
title_sort atlas distributed data management project: past and future
topic Conferences
url http://cds.cern.ch/record/1460548
work_keys_str_mv AT garonnevincent theatlasdistributeddatamanagementprojectpastandfuture
AT garonnevincent computinginhighenergyandnuclearphysicschep2012
AT garonnevincent atlasdistributeddatamanagementprojectpastandfuture