Cargando…

The ATLAS Wide-Range Database & Application Monitoring

In HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we des...

Descripción completa

Detalles Bibliográficos
Autores principales: Vasileva, Petya Tsvetanova, Formica, Andrea, Dimitrov, Gancho
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2625389
_version_ 1780958788162945024
author Vasileva, Petya Tsvetanova
Formica, Andrea
Dimitrov, Gancho
author_facet Vasileva, Petya Tsvetanova
Formica, Andrea
Dimitrov, Gancho
author_sort Vasileva, Petya Tsvetanova
collection CERN
description In HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: concise view of the most important DB metrics; top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; database jobs section with signaling for problematic ones; in-depth analysis in case of contention on data or processes. This contribution describes also the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses gitlab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.
id cern-2625389
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26253892019-11-12T09:44:03Zhttp://cds.cern.ch/record/2625389engVasileva, Petya TsvetanovaFormica, AndreaDimitrov, GanchoThe ATLAS Wide-Range Database & Application MonitoringParticle Physics - ExperimentIn HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: concise view of the most important DB metrics; top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; database jobs section with signaling for problematic ones; in-depth analysis in case of contention on data or processes. This contribution describes also the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses gitlab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.ATL-SOFT-SLIDE-2018-399oai:cds.cern.ch:26253892018-06-23
spellingShingle Particle Physics - Experiment
Vasileva, Petya Tsvetanova
Formica, Andrea
Dimitrov, Gancho
The ATLAS Wide-Range Database & Application Monitoring
title The ATLAS Wide-Range Database & Application Monitoring
title_full The ATLAS Wide-Range Database & Application Monitoring
title_fullStr The ATLAS Wide-Range Database & Application Monitoring
title_full_unstemmed The ATLAS Wide-Range Database & Application Monitoring
title_short The ATLAS Wide-Range Database & Application Monitoring
title_sort atlas wide-range database & application monitoring
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2625389
work_keys_str_mv AT vasilevapetyatsvetanova theatlaswiderangedatabaseapplicationmonitoring
AT formicaandrea theatlaswiderangedatabaseapplicationmonitoring
AT dimitrovgancho theatlaswiderangedatabaseapplicationmonitoring
AT vasilevapetyatsvetanova atlaswiderangedatabaseapplicationmonitoring
AT formicaandrea atlaswiderangedatabaseapplicationmonitoring
AT dimitrovgancho atlaswiderangedatabaseapplicationmonitoring