Cargando…
Investigation of robustness of b-Tagging algorithms for the CMS Experiment
With great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks,...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2862786 |
_version_ | 1780977885697277952 |
---|---|
author | Stein, Annika |
author_facet | Stein, Annika |
author_sort | Stein, Annika |
collection | CERN |
description | With great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks, even if the modifications of the inputs are only marginal. Those intriguing, yet con- cerning properties are analysed in the context of b-tagging, where the chosen architecture replicates the DeepCSV algorithm, which is utilized at the CMS experiment. Investigating the response of the tagger is motivated by the later usage of the outputs in physics analyses, as the values for simulation and data are deviating. The vulnerability of the neural network will be probed by employing adversarial attacks, which involves the addition of a random Gaussian noise term or the systematic application of the Fast Gradient Sign Method. Investigations of the input shapes as well as the ROC curves show how the aforementioned adjustments influence the features and the performance. The scan of the area under the ROC curve over epoch reveals the tradeoff between model per- formance and susceptibility. A defense strategy, namely adversarial training, improves the robustness of the classifier and represents a better tradeoff, compared to the basic training. This method constitutes a promising candidate to reduce discrepancies when evaluating the model on simulated events as well as on data. |
id | cern-2862786 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28627862023-07-17T08:12:02Zhttp://cds.cern.ch/record/2862786engStein, AnnikaInvestigation of robustness of b-Tagging algorithms for the CMS ExperimentDetectors and Experimental TechniquesWith great success, deep learning as one form of machine learning is utilized for various ap- plications and shows its benefits also in the field of high-energy physics, or more specifically, for jet flavour tagging. At the same time, studies on AI safety show the susceptibility of neural networks, even if the modifications of the inputs are only marginal. Those intriguing, yet con- cerning properties are analysed in the context of b-tagging, where the chosen architecture replicates the DeepCSV algorithm, which is utilized at the CMS experiment. Investigating the response of the tagger is motivated by the later usage of the outputs in physics analyses, as the values for simulation and data are deviating. The vulnerability of the neural network will be probed by employing adversarial attacks, which involves the addition of a random Gaussian noise term or the systematic application of the Fast Gradient Sign Method. Investigations of the input shapes as well as the ROC curves show how the aforementioned adjustments influence the features and the performance. The scan of the area under the ROC curve over epoch reveals the tradeoff between model per- formance and susceptibility. A defense strategy, namely adversarial training, improves the robustness of the classifier and represents a better tradeoff, compared to the basic training. This method constitutes a promising candidate to reduce discrepancies when evaluating the model on simulated events as well as on data.CERN-THESIS-2021-367oai:cds.cern.ch:28627862023-06-23T14:05:13Z |
spellingShingle | Detectors and Experimental Techniques Stein, Annika Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title | Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title_full | Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title_fullStr | Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title_full_unstemmed | Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title_short | Investigation of robustness of b-Tagging algorithms for the CMS Experiment |
title_sort | investigation of robustness of b-tagging algorithms for the cms experiment |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/2862786 |
work_keys_str_mv | AT steinannika investigationofrobustnessofbtaggingalgorithmsforthecmsexperiment |