Cargando…

Investigation of robustness of b-Tagging algorithms for the CMS Experiment

With great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks,...

Descripción completa

Detalles Bibliográficos
Autor principal: Stein, Annika
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2862786
_version_ 1780977885697277952
author Stein, Annika
author_facet Stein, Annika
author_sort Stein, Annika
collection CERN
description With great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks, even if the modifications of the inputs are only marginal. Those intriguing, yet con- cerning properties are analysed in the context of b-tagging, where the chosen architecture replicates the DeepCSV algorithm, which is utilized at the CMS experiment. Investigating the response of the tagger is motivated by the later usage of the outputs in physics analyses, as the values for simulation and data are deviating. The vulnerability of the neural network will be probed by employing adversarial attacks, which involves the addition of a random Gaussian noise term or the systematic application of the Fast Gradient Sign Method. Investigations of the input shapes as well as the ROC curves show how the aforementioned adjustments influence the features and the performance. The scan of the area under the ROC curve over epoch reveals the tradeoff between model per- formance and susceptibility. A defense strategy, namely adversarial training, improves the robustness of the classifier and represents a better tradeoff, compared to the basic training. This method constitutes a promising candidate to reduce discrepancies when evaluating the model on simulated events as well as on data.
id cern-2862786
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28627862023-07-17T08:12:02Zhttp://cds.cern.ch/record/2862786engStein, AnnikaInvestigation of robustness of b-Tagging algorithms for the CMS ExperimentDetectors and Experimental TechniquesWith great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks, even if the modifications of the inputs are only marginal. Those intriguing, yet con- cerning properties are analysed in the context of b-tagging, where the chosen architecture replicates the DeepCSV algorithm, which is utilized at the CMS experiment. Investigating the response of the tagger is motivated by the later usage of the outputs in physics analyses, as the values for simulation and data are deviating. The vulnerability of the neural network will be probed by employing adversarial attacks, which involves the addition of a random Gaussian noise term or the systematic application of the Fast Gradient Sign Method. Investigations of the input shapes as well as the ROC curves show how the aforementioned adjustments influence the features and the performance. The scan of the area under the ROC curve over epoch reveals the tradeoff between model per- formance and susceptibility. A defense strategy, namely adversarial training, improves the robustness of the classifier and represents a better tradeoff, compared to the basic training. This method constitutes a promising candidate to reduce discrepancies when evaluating the model on simulated events as well as on data.CERN-THESIS-2021-367oai:cds.cern.ch:28627862023-06-23T14:05:13Z
spellingShingle Detectors and Experimental Techniques
Stein, Annika
Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title_full Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title_fullStr Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title_full_unstemmed Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title_short Investigation of robustness of b-Tagging algorithms for the CMS Experiment
title_sort investigation of robustness of b-tagging algorithms for the cms experiment
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/2862786
work_keys_str_mv AT steinannika investigationofrobustnessofbtaggingalgorithmsforthecmsexperiment