Cargando…

The importance of having an appropriate data segmentation (partitioning)

In this presentation will be shown real life examples from database applications in the ATLAS experiment @ LHC where we make use of many Oracle partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning we add our own l...

Descripción completa

Detalles Bibliográficos
Autor principal: Dimitrov, Gancho
Lenguaje:eng
Publicado: 2014
Materias:
Acceso en línea:http://cds.cern.ch/record/1967670
_version_ 1780944610441297920
author Dimitrov, Gancho
author_facet Dimitrov, Gancho
author_sort Dimitrov, Gancho
collection CERN
description In this presentation will be shown real life examples from database applications in the ATLAS experiment @ LHC where we make use of many Oracle partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning we add our own logic in PLSQL for sustaining data sliding windows in order to enforce various data retention policies. We also make use of the reference partitioning in some use cases, however the most challenging was to segment the data of a large bookkeeping system which resulted in tens of thousands list partitions and list sub-partitions. Partition and sub-partition management, index strategy, statistics gathering and queries execution plan stability are important factors when choosing an appropriate for the use case data management model. The gained experience with all of those will be shared with the audience.
id cern-1967670
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2014
record_format invenio
spelling cern-19676702019-09-30T06:29:59Zhttp://cds.cern.ch/record/1967670engDimitrov, GanchoThe importance of having an appropriate data segmentation (partitioning)Particle Physics - ExperimentIn this presentation will be shown real life examples from database applications in the ATLAS experiment @ LHC where we make use of many Oracle partitioning techniques available in Oracle 11g. With the broadly used range partitioning and its option of automatic interval partitioning we add our own logic in PLSQL for sustaining data sliding windows in order to enforce various data retention policies. We also make use of the reference partitioning in some use cases, however the most challenging was to segment the data of a large bookkeeping system which resulted in tens of thousands list partitions and list sub-partitions. Partition and sub-partition management, index strategy, statistics gathering and queries execution plan stability are important factors when choosing an appropriate for the use case data management model. The gained experience with all of those will be shared with the audience.ATL-SOFT-SLIDE-2014-791oai:cds.cern.ch:19676702014-11-08
spellingShingle Particle Physics - Experiment
Dimitrov, Gancho
The importance of having an appropriate data segmentation (partitioning)
title The importance of having an appropriate data segmentation (partitioning)
title_full The importance of having an appropriate data segmentation (partitioning)
title_fullStr The importance of having an appropriate data segmentation (partitioning)
title_full_unstemmed The importance of having an appropriate data segmentation (partitioning)
title_short The importance of having an appropriate data segmentation (partitioning)
title_sort importance of having an appropriate data segmentation (partitioning)
topic Particle Physics - Experiment
url http://cds.cern.ch/record/1967670
work_keys_str_mv AT dimitrovgancho theimportanceofhavinganappropriatedatasegmentationpartitioning
AT dimitrovgancho importanceofhavinganappropriatedatasegmentationpartitioning