Cargando…
The ATLAS Wide-Range Database & Application Monitoring
In HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we des...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2625389 |
_version_ | 1780958788162945024 |
---|---|
author | Vasileva, Petya Tsvetanova Formica, Andrea Dimitrov, Gancho |
author_facet | Vasileva, Petya Tsvetanova Formica, Andrea Dimitrov, Gancho |
author_sort | Vasileva, Petya Tsvetanova |
collection | CERN |
description | In HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: concise view of the most important DB metrics; top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; database jobs section with signaling for problematic ones; in-depth analysis in case of contention on data or processes. This contribution describes also the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses gitlab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure. |
id | cern-2625389 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26253892019-11-12T09:44:03Zhttp://cds.cern.ch/record/2625389engVasileva, Petya TsvetanovaFormica, AndreaDimitrov, GanchoThe ATLAS Wide-Range Database & Application MonitoringParticle Physics - ExperimentIn HEP experiments at LHC the database applications often become complex by reflecting the ever demanding requirements of the researchers. The ATLAS experiment has several Oracle DB clusters with over 216 database schemes each with its own set of database objects. To effectively monitor them, we designed a modern and portable application with exceptionally good characteristics. Some of them include: concise view of the most important DB metrics; top SQL statements based on CPU, executions, block reads, etc.; volume growth plots per schema and DB object type; database jobs section with signaling for problematic ones; in-depth analysis in case of contention on data or processes. This contribution describes also the technical aspects of the implementation. The project can be separated into three independent layers. The first layer consists in highly-optimized database objects hiding all complicated calculations. The second layer represents a server providing REST access to the underlying database backend. The third layer is a JavaScript/AngularJS web interface. In addition, we will summarize the continuous integration cycle of the application, which uses gitlab-ci pipelines for basic testing, containerization and deployment on the CERN Openshift infrastructure.ATL-SOFT-SLIDE-2018-399oai:cds.cern.ch:26253892018-06-23 |
spellingShingle | Particle Physics - Experiment Vasileva, Petya Tsvetanova Formica, Andrea Dimitrov, Gancho The ATLAS Wide-Range Database & Application Monitoring |
title | The ATLAS Wide-Range Database & Application Monitoring |
title_full | The ATLAS Wide-Range Database & Application Monitoring |
title_fullStr | The ATLAS Wide-Range Database & Application Monitoring |
title_full_unstemmed | The ATLAS Wide-Range Database & Application Monitoring |
title_short | The ATLAS Wide-Range Database & Application Monitoring |
title_sort | atlas wide-range database & application monitoring |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2625389 |
work_keys_str_mv | AT vasilevapetyatsvetanova theatlaswiderangedatabaseapplicationmonitoring AT formicaandrea theatlaswiderangedatabaseapplicationmonitoring AT dimitrovgancho theatlaswiderangedatabaseapplicationmonitoring AT vasilevapetyatsvetanova atlaswiderangedatabaseapplicationmonitoring AT formicaandrea atlaswiderangedatabaseapplicationmonitoring AT dimitrovgancho atlaswiderangedatabaseapplicationmonitoring |