Cargando…
The ATLAS wide-range database and application monitoring
In HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them,...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921404036 http://cds.cern.ch/record/2648964 |
_version_ | 1780960709697339392 |
---|---|
author | Vasileva, Petya Dimitrov, Gancho Formica, Andrea |
author_facet | Vasileva, Petya Dimitrov, Gancho Formica, Andrea |
author_sort | Vasileva, Petya |
collection | CERN |
description | In HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: A concise view of the most important DBmetrics; a list of top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; a database jobs section with signalization for failures; and in-depth analysis in case of row-lock contention or DB sessions. This contribution also describes the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses GitLab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure. |
id | cern-2648964 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26489642022-08-10T12:23:52Zdoi:10.1051/epjconf/201921404036http://cds.cern.ch/record/2648964engVasileva, PetyaDimitrov, GanchoFormica, AndreaThe ATLAS wide-range database and application monitoringParticle Physics - ExperimentIn HEP experiments at LHC the database applications often become complex, reflecting the increasingly demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: A concise view of the most important DBmetrics; a list of top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; a database jobs section with signalization for failures; and in-depth analysis in case of row-lock contention or DB sessions. This contribution also describes the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses GitLab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.ATL-SOFT-PROC-2018-035oai:cds.cern.ch:26489642018-11-26 |
spellingShingle | Particle Physics - Experiment Vasileva, Petya Dimitrov, Gancho Formica, Andrea The ATLAS wide-range database and application monitoring |
title | The ATLAS wide-range database and application monitoring |
title_full | The ATLAS wide-range database and application monitoring |
title_fullStr | The ATLAS wide-range database and application monitoring |
title_full_unstemmed | The ATLAS wide-range database and application monitoring |
title_short | The ATLAS wide-range database and application monitoring |
title_sort | atlas wide-range database and application monitoring |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1051/epjconf/201921404036 http://cds.cern.ch/record/2648964 |
work_keys_str_mv | AT vasilevapetya theatlaswiderangedatabaseandapplicationmonitoring AT dimitrovgancho theatlaswiderangedatabaseandapplicationmonitoring AT formicaandrea theatlaswiderangedatabaseandapplicationmonitoring AT vasilevapetya atlaswiderangedatabaseandapplicationmonitoring AT dimitrovgancho atlaswiderangedatabaseandapplicationmonitoring AT formicaandrea atlaswiderangedatabaseandapplicationmonitoring |