Cargando…
Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter
The online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the exis...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2855338 |
_version_ | 1780977446868221952 |
---|---|
author | Harilal, Abhirami Park, Kyungmin Andrews, Michael Benjamin Paulini, Manfred |
author_facet | Harilal, Abhirami Park, Kyungmin Andrews, Michael Benjamin Paulini, Manfred |
author_sort | Harilal, Abhirami |
collection | CERN |
description | The online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the existing ECAL DQM system has been continuously updated to respond to new problems, it remains one step behind newer and unforeseen issues. Using unsupervised deep learning, a real-time autoencoder-based anomaly detection system is developed that is able to detect ECAL anomalies unseen in past data. After accounting for spatial variations in the response of the ECAL and the temporal evolution of anomalies, the new system is able to efficiently detect anomalies while maintaining an estimated false discovery rate between $10^{-2}$ to $10^{-4}$, beating existing benchmarks by about two orders of magnitude. The real-world performance of the system is validated using anomalies found in 2018 and 2022 LHC collision data. Additionally, first results from deploying the autoencoder-based system in the CMS online DQM workflow for the ECAL barrel during Run\,3 of the LHC are presented, showing its promising performance in detecting obscure issues that could have been missed in the existing DQM system. |
id | cern-2855338 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28553382023-04-03T19:01:39Zhttp://cds.cern.ch/record/2855338engHarilal, AbhiramiPark, KyungminAndrews, Michael BenjaminPaulini, ManfredAutoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic CalorimeterDetectors and Experimental TechniquesThe online Data Quality Monitoring system (DQM) of the CMS electromagnetic calorimeter (ECAL) is a crucial operational tool that allows ECAL experts to quickly identify, localize, and diagnose a broad range of detector issues that would otherwise hinder physics-quality data taking. Although the existing ECAL DQM system has been continuously updated to respond to new problems, it remains one step behind newer and unforeseen issues. Using unsupervised deep learning, a real-time autoencoder-based anomaly detection system is developed that is able to detect ECAL anomalies unseen in past data. After accounting for spatial variations in the response of the ECAL and the temporal evolution of anomalies, the new system is able to efficiently detect anomalies while maintaining an estimated false discovery rate between $10^{-2}$ to $10^{-4}$, beating existing benchmarks by about two orders of magnitude. The real-world performance of the system is validated using anomalies found in 2018 and 2022 LHC collision data. Additionally, first results from deploying the autoencoder-based system in the CMS online DQM workflow for the ECAL barrel during Run\,3 of the LHC are presented, showing its promising performance in detecting obscure issues that could have been missed in the existing DQM system.CMS-CR-2023-020oai:cds.cern.ch:28553382023-02-24 |
spellingShingle | Detectors and Experimental Techniques Harilal, Abhirami Park, Kyungmin Andrews, Michael Benjamin Paulini, Manfred Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title | Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title_full | Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title_fullStr | Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title_full_unstemmed | Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title_short | Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter |
title_sort | autoencoder-based online data quality monitoring for the cms electromagnetic calorimeter |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/2855338 |
work_keys_str_mv | AT harilalabhirami autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter AT parkkyungmin autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter AT andrewsmichaelbenjamin autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter AT paulinimanfred autoencoderbasedonlinedataqualitymonitoringforthecmselectromagneticcalorimeter |