Cargando…

The ATLAS wide-range database and application monitoring

In HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them,...

Descripción completa

Detalles Bibliográficos
Autores principales: Vasileva, Petya, Dimitrov, Gancho, Formica, Andrea
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404036
http://cds.cern.ch/record/2648964
_version_ 1780960709697339392
author Vasileva, Petya
Dimitrov, Gancho
Formica, Andrea
author_facet Vasileva, Petya
Dimitrov, Gancho
Formica, Andrea
author_sort Vasileva, Petya
collection CERN
description In HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: A concise view of the most important DBmetrics; a list of top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; a database jobs section with signalization for failures; and in-depth analysis in case of row-lock contention or DB sessions. This contribution also describes the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses GitLab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.
id cern-2648964
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26489642022-08-10T12:23:52Zdoi:10.1051/epjconf/201921404036http://cds.cern.ch/record/2648964engVasileva, PetyaDimitrov, GanchoFormica, AndreaThe ATLAS wide-range database and application monitoringParticle Physics - ExperimentIn HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: A concise view of the most important DBmetrics; a list of top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; a database jobs section with signalization for failures; and in-depth analysis in case of row-lock contention or DB sessions. This contribution also describes the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses GitLab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.ATL-SOFT-PROC-2018-035oai:cds.cern.ch:26489642018-11-26
spellingShingle Particle Physics - Experiment
Vasileva, Petya
Dimitrov, Gancho
Formica, Andrea
The ATLAS wide-range database and application monitoring
title The ATLAS wide-range database and application monitoring
title_full The ATLAS wide-range database and application monitoring
title_fullStr The ATLAS wide-range database and application monitoring
title_full_unstemmed The ATLAS wide-range database and application monitoring
title_short The ATLAS wide-range database and application monitoring
title_sort atlas wide-range database and application monitoring
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/201921404036
http://cds.cern.ch/record/2648964
work_keys_str_mv AT vasilevapetya theatlaswiderangedatabaseandapplicationmonitoring
AT dimitrovgancho theatlaswiderangedatabaseandapplicationmonitoring
AT formicaandrea theatlaswiderangedatabaseandapplicationmonitoring
AT vasilevapetya atlaswiderangedatabaseandapplicationmonitoring
AT dimitrovgancho atlaswiderangedatabaseandapplicationmonitoring
AT formicaandrea atlaswiderangedatabaseandapplicationmonitoring