The one-million table partitions challenge in an ATLAS experiment DB application

<!--HTML-->How can a new database system which manages billions of rows with relatively short lifetime (weeks to months) be designed ? The system should resemble a Whiteboard: - data, grouped by given properties form data collections, are added when requested - data collections are consumed b...

Descripción completa

Detalles Bibliográficos
Autor principal: Dimitrov, Gancho
Lenguaje:eng
Publicado: 2019
Materias:
IT Lightning Talks (ITLT)
Acceso en línea:http://cds.cern.ch/record/2673987
_version_ 1780962555301199872
author Dimitrov, Gancho
author_facet Dimitrov, Gancho
author_sort Dimitrov, Gancho
collection CERN
description <!--HTML-->How can a new database system which manages billions of rows with relatively short lifetime (weeks to months) be designed ? The system should resemble a Whiteboard: - data, grouped by given properties form data collections, are added when requested - data collections are consumed by the requestor - when not needed any more, data collections are removed by a "Whiteboard sponge" process. I will show you what options I explored and which one is potentially the best in terms of efficiency.
id cern-2673987
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26739872022-11-02T22:13:24Zhttp://cds.cern.ch/record/2673987engDimitrov, GanchoThe one-million table partitions challenge in an ATLAS experiment DB applicationIT Lightning Talks: session #18IT Lightning Talks (ITLT)<!--HTML-->How can a new database system which manages billions of rows with relatively short lifetime (weeks to months) be designed ? The system should resemble a Whiteboard: - data, grouped by given properties form data collections, are added when requested - data collections are consumed by the requestor - when not needed any more, data collections are removed by a "Whiteboard sponge" process. I will show you what options I explored and which one is potentially the best in terms of efficiency.oai:cds.cern.ch:26739872019
spellingShingle IT Lightning Talks (ITLT)
Dimitrov, Gancho
The one-million table partitions challenge in an ATLAS experiment DB application
title The one-million table partitions challenge in an ATLAS experiment DB application
title_full The one-million table partitions challenge in an ATLAS experiment DB application
title_fullStr The one-million table partitions challenge in an ATLAS experiment DB application
title_full_unstemmed The one-million table partitions challenge in an ATLAS experiment DB application
title_short The one-million table partitions challenge in an ATLAS experiment DB application
title_sort one-million table partitions challenge in an atlas experiment db application
topic IT Lightning Talks (ITLT)
url http://cds.cern.ch/record/2673987
work_keys_str_mv AT dimitrovgancho theonemilliontablepartitionschallengeinanatlasexperimentdbapplication
AT dimitrovgancho itlightningtalkssession18
AT dimitrovgancho onemilliontablepartitionschallengeinanatlasexperimentdbapplication

Ejemplares similares