Cargando…

Monitoring and controlling ATLAS data management: The Rucio web user interface

The monitoring and controlling interfaces of the previous data management system DQ2 followed the evolutionary requirements and needs of the ATLAS collaboration. The new system, Rucio, has put in place a redesigned web-based interface based upon the lessons learnt from DQ2, and the increased volume...

Descripción completa

Detalles Bibliográficos
Autores principales: Lassnig, Mario, Beermann, Thomas Alfons, Barisits, Martin-Stefan, Serfon, Cedric, Vigne, Ralph, Garonne, Vincent
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:http://cds.cern.ch/record/2004819
_version_ 1780946127577677824
author Lassnig, Mario
Beermann, Thomas Alfons
Barisits, Martin-Stefan
Serfon, Cedric
Vigne, Ralph
Garonne, Vincent
author_facet Lassnig, Mario
Beermann, Thomas Alfons
Barisits, Martin-Stefan
Serfon, Cedric
Vigne, Ralph
Garonne, Vincent
author_sort Lassnig, Mario
collection CERN
description The monitoring and controlling interfaces of the previous data management system DQ2 followed the evolutionary requirements and needs of the ATLAS collaboration. The new system, Rucio, has put in place a redesigned web-based interface based upon the lessons learnt from DQ2, and the increased volume of managed information. This interface encompasses both a monitoring and controlling component, and allows easy integration for user-generated views. The interface follows three design principles. First, the collection and storage of data from internal and external systems is asynchronous to reduce latency. This includes the use of technologies like ActiveMQ or Nagios. Second, analysis of the data into information is done massively parallel due to its volume, using a combined approach with an Oracle database and Hadoop MapReduce. Third, sharing of the information does not distinguish between human or programmatic access, making it easy to access selective parts of the information both in constrained frontends like web-browsers as well as remote services. This contribution will detail the reasons for these principles and the design choices taken. Additionally, the implementation, the interactions with external systems, and an evaluation of the system in production, both from a technological and user perspective, conclude this contribution.
id cern-2004819
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20048192019-09-30T06:29:59Zhttp://cds.cern.ch/record/2004819engLassnig, MarioBeermann, Thomas AlfonsBarisits, Martin-StefanSerfon, CedricVigne, RalphGaronne, VincentMonitoring and controlling ATLAS data management: The Rucio web user interfaceParticle Physics - ExperimentThe monitoring and controlling interfaces of the previous data management system DQ2 followed the evolutionary requirements and needs of the ATLAS collaboration. The new system, Rucio, has put in place a redesigned web-based interface based upon the lessons learnt from DQ2, and the increased volume of managed information. This interface encompasses both a monitoring and controlling component, and allows easy integration for user-generated views. The interface follows three design principles. First, the collection and storage of data from internal and external systems is asynchronous to reduce latency. This includes the use of technologies like ActiveMQ or Nagios. Second, analysis of the data into information is done massively parallel due to its volume, using a combined approach with an Oracle database and Hadoop MapReduce. Third, sharing of the information does not distinguish between human or programmatic access, making it easy to access selective parts of the information both in constrained frontends like web-browsers as well as remote services. This contribution will detail the reasons for these principles and the design choices taken. Additionally, the implementation, the interactions with external systems, and an evaluation of the system in production, both from a technological and user perspective, conclude this contribution.ATL-SOFT-SLIDE-2015-114oai:cds.cern.ch:20048192015-03-27
spellingShingle Particle Physics - Experiment
Lassnig, Mario
Beermann, Thomas Alfons
Barisits, Martin-Stefan
Serfon, Cedric
Vigne, Ralph
Garonne, Vincent
Monitoring and controlling ATLAS data management: The Rucio web user interface
title Monitoring and controlling ATLAS data management: The Rucio web user interface
title_full Monitoring and controlling ATLAS data management: The Rucio web user interface
title_fullStr Monitoring and controlling ATLAS data management: The Rucio web user interface
title_full_unstemmed Monitoring and controlling ATLAS data management: The Rucio web user interface
title_short Monitoring and controlling ATLAS data management: The Rucio web user interface
title_sort monitoring and controlling atlas data management: the rucio web user interface
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2004819
work_keys_str_mv AT lassnigmario monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface
AT beermannthomasalfons monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface
AT barisitsmartinstefan monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface
AT serfoncedric monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface
AT vigneralph monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface
AT garonnevincent monitoringandcontrollingatlasdatamanagementtheruciowebuserinterface