Cargando…

A fast and flexible machine learning approach to data quality monitoring

We present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio h...

Descripción completa

Detalles Bibliográficos
Autores principales: Grosso, Gaia, Lai, Nicolò, Letizia, Marco, Pazzini, Jacopo, Rando, Marco, Wulzer, Andrea, Zanetti, Marco
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2856519
_version_ 1780977513839722496
author Grosso, Gaia
Lai, Nicolò
Letizia, Marco
Pazzini, Jacopo
Rando, Marco
Wulzer, Andrea
Zanetti, Marco
author_facet Grosso, Gaia
Lai, Nicolò
Letizia, Marco
Pazzini, Jacopo
Rando, Marco
Wulzer, Andrea
Zanetti, Marco
author_sort Grosso, Gaia
collection CERN
description We present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio hypothesis test. The core model is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any continuous function given enough data. The resulting algorithm is fast, efficient and agnostic about the type of potential anomaly in the data. We show the performance of the model on multivariate data from a drift tube chambers muon detector.
id cern-2856519
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28565192023-10-12T05:22:28Zhttp://cds.cern.ch/record/2856519engGrosso, GaiaLai, NicolòLetizia, MarcoPazzini, JacopoRando, MarcoWulzer, AndreaZanetti, MarcoA fast and flexible machine learning approach to data quality monitoringhep-exParticle Physics - ExperimentWe present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio hypothesis test. The core model is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any continuous function given enough data. The resulting algorithm is fast, efficient and agnostic about the type of potential anomaly in the data. We show the performance of the model on multivariate data from a drift tube chambers muon detector.arXiv:2301.08917oai:cds.cern.ch:28565192023-01-21
spellingShingle hep-ex
Particle Physics - Experiment
Grosso, Gaia
Lai, Nicolò
Letizia, Marco
Pazzini, Jacopo
Rando, Marco
Wulzer, Andrea
Zanetti, Marco
A fast and flexible machine learning approach to data quality monitoring
title A fast and flexible machine learning approach to data quality monitoring
title_full A fast and flexible machine learning approach to data quality monitoring
title_fullStr A fast and flexible machine learning approach to data quality monitoring
title_full_unstemmed A fast and flexible machine learning approach to data quality monitoring
title_short A fast and flexible machine learning approach to data quality monitoring
title_sort fast and flexible machine learning approach to data quality monitoring
topic hep-ex
Particle Physics - Experiment
url http://cds.cern.ch/record/2856519
work_keys_str_mv AT grossogaia afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT lainicolo afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT letiziamarco afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT pazzinijacopo afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT randomarco afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT wulzerandrea afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT zanettimarco afastandflexiblemachinelearningapproachtodataqualitymonitoring
AT grossogaia fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT lainicolo fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT letiziamarco fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT pazzinijacopo fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT randomarco fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT wulzerandrea fastandflexiblemachinelearningapproachtodataqualitymonitoring
AT zanettimarco fastandflexiblemachinelearningapproachtodataqualitymonitoring