Cargando…

Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter

The online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the exis...

Descripción completa

Detalles Bibliográficos
Autores principales: Harilal, Abhirami, Park, Kyungmin, Andrews, Michael Benjamin, Paulini, Manfred
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2855338
_version_ 1780977446868221952
author Harilal, Abhirami
Park, Kyungmin
Andrews, Michael Benjamin
Paulini, Manfred
author_facet Harilal, Abhirami
Park, Kyungmin
Andrews, Michael Benjamin
Paulini, Manfred
author_sort Harilal, Abhirami
collection CERN
description The online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the existing ECAL DQM system has been continuously updated to respond to new problems, it remains one step behind newer and unforeseen issues. Using unsupervised deep learning, a real-time autoencoder-based anomaly detection system is developed that is able to detect ECAL anomalies unseen in past data. After accounting for spatial variations in the response of the ECAL and the temporal evolution of anomalies, the new system is able to efficiently detect anomalies while maintaining an estimated false discovery rate between $10^{-2}$ to $10^{-4}$, beating existing benchmarks by about two orders of magnitude. The real-world performance of the system is validated using anomalies found in 2018 and 2022 LHC collision data. Additionally, first results from deploying the autoencoder-based system in the CMS online DQM workflow for the ECAL barrel during Run\,3 of the LHC are presented, showing its promising performance in detecting obscure issues that could have been missed in the existing DQM system.
id cern-2855338
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28553382023-04-03T19:01:39Zhttp://cds.cern.ch/record/2855338engHarilal, AbhiramiPark, KyungminAndrews, Michael BenjaminPaulini, ManfredAutoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic CalorimeterDetectors and Experimental TechniquesThe online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the existing ECAL DQM system has been continuously updated to respond to new problems, it remains one step behind newer and unforeseen issues. Using unsupervised deep learning, a real-time autoencoder-based anomaly detection system is developed that is able to detect ECAL anomalies unseen in past data. After accounting for spatial variations in the response of the ECAL and the temporal evolution of anomalies, the new system is able to efficiently detect anomalies while maintaining an estimated false discovery rate between $10^{-2}$ to $10^{-4}$, beating existing benchmarks by about two orders of magnitude. The real-world performance of the system is validated using anomalies found in 2018 and 2022 LHC collision data. Additionally, first results from deploying the autoencoder-based system in the CMS online DQM workflow for the ECAL barrel during Run\,3 of the LHC are presented, showing its promising performance in detecting obscure issues that could have been missed in the existing DQM system.CMS-CR-2023-020oai:cds.cern.ch:28553382023-02-24
spellingShingle Detectors and Experimental Techniques
Harilal, Abhirami
Park, Kyungmin
Andrews, Michael Benjamin
Paulini, Manfred
Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title_full Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title_fullStr Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title_full_unstemmed Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title_short Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
title_sort autoencoder-based online data quality monitoring for the cms electromagnetic calorimeter
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/2855338
work_keys_str_mv AT harilalabhirami autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter
AT parkkyungmin autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter
AT andrewsmichaelbenjamin autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter
AT paulinimanfred autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter