Cargando…

The importance of having an appropriate relational data segmentation in ATLAS

In this paper we describe specific technical solutions put in place in various database applications of the ATLAS experiment at LHC where we make use of several partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning...

Descripción completa

Detalles Bibliográficos
Autor principal: Dimitrov, Gancho
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042010
http://cds.cern.ch/record/2015474
_version_ 1780946687515164672
author Dimitrov, Gancho
author_facet Dimitrov, Gancho
author_sort Dimitrov, Gancho
collection CERN
description In this paper we describe specific technical solutions put in place in various database applications of the ATLAS experiment at LHC where we make use of several partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning we add our own logic in PLSQL procedures and scheduler jobs to sustain data sliding windows in order to enforce various data retention policies. We also make use of the new Oracle 11g reference partitioning in the Nightly Build System to achieve uniform data segmentation. However the most challenging issue was to segment the data of the new ATLAS Distributed Data Management system (Rucio), which resulted in tens of thousands list type partitions and sub-partitions. Partition and sub-partition management, index strategy, statistics gathering and queries execution plan stability are important factors when choosing an appropriate physical model for the application data management. The so-far accumulated knowledge and analysis on the new Oracle 12c version features that could be beneficial will be shared with the audience.
id cern-2015474
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20154742022-08-10T12:53:05Zdoi:10.1088/1742-6596/664/4/042010http://cds.cern.ch/record/2015474engDimitrov, GanchoThe importance of having an appropriate relational data segmentation in ATLASParticle Physics - ExperimentComputing and ComputersIn this paper we describe specific technical solutions put in place in various database applications of the ATLAS experiment at LHC where we make use of several partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning we add our own logic in PLSQL procedures and scheduler jobs to sustain data sliding windows in order to enforce various data retention policies. We also make use of the new Oracle 11g reference partitioning in the Nightly Build System to achieve uniform data segmentation. However the most challenging issue was to segment the data of the new ATLAS Distributed Data Management system (Rucio), which resulted in tens of thousands list type partitions and sub-partitions. Partition and sub-partition management, index strategy, statistics gathering and queries execution plan stability are important factors when choosing an appropriate physical model for the application data management. The so-far accumulated knowledge and analysis on the new Oracle 12c version features that could be beneficial will be shared with the audience.ATL-SOFT-PROC-2015-024oai:cds.cern.ch:20154742015-05-12
spellingShingle Particle Physics - Experiment
Computing and Computers
Dimitrov, Gancho
The importance of having an appropriate relational data segmentation in ATLAS
title The importance of having an appropriate relational data segmentation in ATLAS
title_full The importance of having an appropriate relational data segmentation in ATLAS
title_fullStr The importance of having an appropriate relational data segmentation in ATLAS
title_full_unstemmed The importance of having an appropriate relational data segmentation in ATLAS
title_short The importance of having an appropriate relational data segmentation in ATLAS
title_sort importance of having an appropriate relational data segmentation in atlas
topic Particle Physics - Experiment
Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/4/042010
http://cds.cern.ch/record/2015474
work_keys_str_mv AT dimitrovgancho theimportanceofhavinganappropriaterelationaldatasegmentationinatlas
AT dimitrovgancho importanceofhavinganappropriaterelationaldatasegmentationinatlas