Cargando…
A fast and flexible machine learning approach to data quality monitoring
We present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio h...
Autores principales: | , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2856519 |
_version_ | 1780977513839722496 |
---|---|
author | Grosso, Gaia Lai, Nicolò Letizia, Marco Pazzini, Jacopo Rando, Marco Wulzer, Andrea Zanetti, Marco |
author_facet | Grosso, Gaia Lai, Nicolò Letizia, Marco Pazzini, Jacopo Rando, Marco Wulzer, Andrea Zanetti, Marco |
author_sort | Grosso, Gaia |
collection | CERN |
description | We present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio hypothesis test. The core model is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any continuous function given enough data. The resulting algorithm is fast, efficient and agnostic about the type of potential anomaly in the data. We show the performance of the model on multivariate data from a drift tube chambers muon detector. |
id | cern-2856519 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28565192023-10-12T05:22:28Zhttp://cds.cern.ch/record/2856519engGrosso, GaiaLai, NicolòLetizia, MarcoPazzini, JacopoRando, MarcoWulzer, AndreaZanetti, MarcoA fast and flexible machine learning approach to data quality monitoringhep-exParticle Physics - ExperimentWe present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data behavior in normal conditions by implementing a likelihood-ratio hypothesis test. The core model is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any continuous function given enough data. The resulting algorithm is fast, efficient and agnostic about the type of potential anomaly in the data. We show the performance of the model on multivariate data from a drift tube chambers muon detector.arXiv:2301.08917oai:cds.cern.ch:28565192023-01-21 |
spellingShingle | hep-ex Particle Physics - Experiment Grosso, Gaia Lai, Nicolò Letizia, Marco Pazzini, Jacopo Rando, Marco Wulzer, Andrea Zanetti, Marco A fast and flexible machine learning approach to data quality monitoring |
title | A fast and flexible machine learning approach to data quality monitoring |
title_full | A fast and flexible machine learning approach to data quality monitoring |
title_fullStr | A fast and flexible machine learning approach to data quality monitoring |
title_full_unstemmed | A fast and flexible machine learning approach to data quality monitoring |
title_short | A fast and flexible machine learning approach to data quality monitoring |
title_sort | fast and flexible machine learning approach to data quality monitoring |
topic | hep-ex Particle Physics - Experiment |
url | http://cds.cern.ch/record/2856519 |
work_keys_str_mv | AT grossogaia afastandflexiblemachinelearningapproachtodataqualitymonitoring AT lainicolo afastandflexiblemachinelearningapproachtodataqualitymonitoring AT letiziamarco afastandflexiblemachinelearningapproachtodataqualitymonitoring AT pazzinijacopo afastandflexiblemachinelearningapproachtodataqualitymonitoring AT randomarco afastandflexiblemachinelearningapproachtodataqualitymonitoring AT wulzerandrea afastandflexiblemachinelearningapproachtodataqualitymonitoring AT zanettimarco afastandflexiblemachinelearningapproachtodataqualitymonitoring AT grossogaia fastandflexiblemachinelearningapproachtodataqualitymonitoring AT lainicolo fastandflexiblemachinelearningapproachtodataqualitymonitoring AT letiziamarco fastandflexiblemachinelearningapproachtodataqualitymonitoring AT pazzinijacopo fastandflexiblemachinelearningapproachtodataqualitymonitoring AT randomarco fastandflexiblemachinelearningapproachtodataqualitymonitoring AT wulzerandrea fastandflexiblemachinelearningapproachtodataqualitymonitoring AT zanettimarco fastandflexiblemachinelearningapproachtodataqualitymonitoring |