Cargando…

AI Enabled Data Quality Monitoring with Hydra

<!--HTML-->Data quality monitoring is critical to all experiments impacting the quality of any physics results. Traditionally, this is done through an alarm system, which detects low level faults, leaving higher level monitoring to human crews. Artificial Intelligence is beginning to find its...

Descripción completa

Detalles Bibliográficos
Autor principal: Britton, Thomas
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2767166
_version_ 1780971277075349504
author Britton, Thomas
author_facet Britton, Thomas
author_sort Britton, Thomas
collection CERN
description <!--HTML-->Data quality monitoring is critical to all experiments impacting the quality of any physics results. Traditionally, this is done through an alarm system, which detects low level faults, leaving higher level monitoring to human crews. Artificial Intelligence is beginning to find its way into scientific applications, but comes with difficulties, relying on the acquisition of new skill sets, either through education or acquisition, in data science. This paper will discuss the development and deployment of the Hydra monitoring system in production at Gluex. It will show how "off-the-shelf" technologies can be rapidly developed, as well as discuss what sociological hurdles must be overcome to successfully deploy such a system. Early results from production running of Hydra will also be shared as well as a future outlook for development of Hydra.
id cern-2767166
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27671662022-11-02T22:25:38Zhttp://cds.cern.ch/record/2767166engBritton, ThomasAI Enabled Data Quality Monitoring with Hydra25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->Data quality monitoring is critical to all experiments impacting the quality of any physics results. Traditionally, this is done through an alarm system, which detects low level faults, leaving higher level monitoring to human crews. Artificial Intelligence is beginning to find its way into scientific applications, but comes with difficulties, relying on the acquisition of new skill sets, either through education or acquisition, in data science. This paper will discuss the development and deployment of the Hydra monitoring system in production at Gluex. It will show how "off-the-shelf" technologies can be rapidly developed, as well as discuss what sociological hurdles must be overcome to successfully deploy such a system. Early results from production running of Hydra will also be shared as well as a future outlook for development of Hydra.oai:cds.cern.ch:27671662021
spellingShingle Conferences
Britton, Thomas
AI Enabled Data Quality Monitoring with Hydra
title AI Enabled Data Quality Monitoring with Hydra
title_full AI Enabled Data Quality Monitoring with Hydra
title_fullStr AI Enabled Data Quality Monitoring with Hydra
title_full_unstemmed AI Enabled Data Quality Monitoring with Hydra
title_short AI Enabled Data Quality Monitoring with Hydra
title_sort ai enabled data quality monitoring with hydra
topic Conferences
url http://cds.cern.ch/record/2767166
work_keys_str_mv AT brittonthomas aienableddataqualitymonitoringwithhydra
AT brittonthomas 25thinternationalconferenceoncomputinginhighenergynuclearphysics