Cargando…

Scalable Database Access Technologies for ATLAS Distributed Computing

ATLAS event data processing requires access to non-event data (detector conditions, calibrations, etc.) stored in relational databases. The database-resident data are crucial for the event data reconstruction processing steps and often required for user analysis. A main focus of ATLAS database opera...

Descripción completa

Detalles Bibliográficos
Autor principal: Vaniachine, A.
Lenguaje:eng
Publicado: 2009
Materias:
Acceso en línea:http://cds.cern.ch/record/1210285
_version_ 1780917996614582272
author Vaniachine, A.
author_facet Vaniachine, A.
author_sort Vaniachine, A.
collection CERN
description ATLAS event data processing requires access to non-event data (detector conditions, calibrations, etc.) stored in relational databases. The database-resident data are crucial for the event data reconstruction processing steps and often required for user analysis. A main focus of ATLAS database operations is on the worldwide distribution of the Conditions DB data, which are necessary for every ATLAS data processing job. Since Conditions DB access is critical for operations with real data, we have developed the system where a different technology can be used as a redundant backup. Redundant database operations infrastructure fully satisfies the requirements of ATLAS reprocessing, which has been proven on a scale of one billion database queries during two reprocessing campaigns of 0.5 PB of single-beam and cosmics data on the Grid. To collect experience and provide input for a best choice of technologies, several promising options for efficient database access in user analysis were evaluated successfully. We present ATLAS experience with scalable database access technologies and describe our approach for prevention of database access bottlenecks in a Grid computing environment.
id cern-1210285
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2009
record_format invenio
spelling cern-12102852023-03-14T19:09:08Zhttp://cds.cern.ch/record/1210285engVaniachine, A.Scalable Database Access Technologies for ATLAS Distributed ComputingDetectors and Experimental TechniquesATLAS event data processing requires access to non-event data (detector conditions, calibrations, etc.) stored in relational databases. The database-resident data are crucial for the event data reconstruction processing steps and often required for user analysis. A main focus of ATLAS database operations is on the worldwide distribution of the Conditions DB data, which are necessary for every ATLAS data processing job. Since Conditions DB access is critical for operations with real data, we have developed the system where a different technology can be used as a redundant backup. Redundant database operations infrastructure fully satisfies the requirements of ATLAS reprocessing, which has been proven on a scale of one billion database queries during two reprocessing campaigns of 0.5 PB of single-beam and cosmics data on the Grid. To collect experience and provide input for a best choice of technologies, several promising options for efficient database access in user analysis were evaluated successfully. We present ATLAS experience with scalable database access technologies and describe our approach for prevention of database access bottlenecks in a Grid computing environment.ATLAS event data processing requires access to non-event data (detector conditions, calibrations, etc.) stored in relational databases. The database-resident data are crucial for the event data reconstruction processing steps and often required for user analysis. A main focus of ATLAS database operations is on the worldwide distribution of the Conditions DB data, which are necessary for every ATLAS data processing job. Since Conditions DB access is critical for operations with real data, we have developed the system where a different technology can be used as a redundant backup. Redundant database operations infrastructure fully satisfies the requirements of ATLAS reprocessing, which has been proven on a scale of one billion database queries during two reprocessing campaigns of 0.5 PB of single-beam and cosmics data on the Grid. To collect experience and provide input for a best choice of technologies, several promising options for efficient database access in user analysis were evaluated successfully. We present ATLAS experience with scalable database access technologies and describe our approach for prevention of database access bottlenecks in a Grid computing environment.arXiv:0910.0097ANL-HEP-CP-09-085ANL-HEP-CP-09-085oai:cds.cern.ch:12102852009-10-02
spellingShingle Detectors and Experimental Techniques
Vaniachine, A.
Scalable Database Access Technologies for ATLAS Distributed Computing
title Scalable Database Access Technologies for ATLAS Distributed Computing
title_full Scalable Database Access Technologies for ATLAS Distributed Computing
title_fullStr Scalable Database Access Technologies for ATLAS Distributed Computing
title_full_unstemmed Scalable Database Access Technologies for ATLAS Distributed Computing
title_short Scalable Database Access Technologies for ATLAS Distributed Computing
title_sort scalable database access technologies for atlas distributed computing
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1210285
work_keys_str_mv AT vaniachinea scalabledatabaseaccesstechnologiesforatlasdistributedcomputing