Cargando…

Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data

Large-scale distributed computing infrastructures ensure the operation and maintenance of scientific experiments at the LHC: more than 160 computing centers all over the World execute tens of millions of computing jobs per day. ATLAS --- the largest experiment at the LHC --- creates an enormous flow...

Descripción completa

Detalles Bibliográficos
Autor principal: The ATLAS collaboration
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:http://cds.cern.ch/record/2742495
_version_ 1780968512056983552
author The ATLAS collaboration
author_facet The ATLAS collaboration
author_sort The ATLAS collaboration
collection CERN
description Large-scale distributed computing infrastructures ensure the operation and maintenance of scientific experiments at the LHC: more than 160 computing centers all over the World execute tens of millions of computing jobs per day. ATLAS --- the largest experiment at the LHC --- creates an enormous flow of data which has to be recorded and analyzed by complex heterogeneous and distributed computing environment. Statistically, about 10-12\% of computing jobs are finished with failures: network faults, service failures, security incidents, and other error conditions trigger error messages which provide detailed information about the issue that can be used for diagnosis and proactive fault handling. However, the analysis is complicated by the sheer scale of textual log data, often exacerbated by the lack of well-defined structure: human experts have to interpret detected messages and create the parsing rules manually, which is time-consuming and does not allow to identify previously unknown error conditions without further human intervention. This paper is dedicated to the description of the pipeline of methods for unsupervised clustering of multi-source error messages. The pipeline is data-driven, based on machine learning algorithms and executed in a fully automated way, allowing to categorize error messages sharing similar textual patterns and meaning.
id cern-2742495
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27424952021-04-19T09:06:23Zhttp://cds.cern.ch/record/2742495engThe ATLAS collaborationClustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics DataParticle Physics - ExperimentLarge-scale distributed computing infrastructures ensure the operation and maintenance of scientific experiments at the LHC: more than 160 computing centers all over the World execute tens of millions of computing jobs per day. ATLAS --- the largest experiment at the LHC --- creates an enormous flow of data which has to be recorded and analyzed by complex heterogeneous and distributed computing environment. Statistically, about 10-12\% of computing jobs are finished with failures: network faults, service failures, security incidents, and other error conditions trigger error messages which provide detailed information about the issue that can be used for diagnosis and proactive fault handling. However, the analysis is complicated by the sheer scale of textual log data, often exacerbated by the lack of well-defined structure: human experts have to interpret detected messages and create the parsing rules manually, which is time-consuming and does not allow to identify previously unknown error conditions without further human intervention. This paper is dedicated to the description of the pipeline of methods for unsupervised clustering of multi-source error messages. The pipeline is data-driven, based on machine learning algorithms and executed in a fully automated way, allowing to categorize error messages sharing similar textual patterns and meaning.ATL-SOFT-PUB-2020-004oai:cds.cern.ch:27424952020-10-22
spellingShingle Particle Physics - Experiment
The ATLAS collaboration
Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title_full Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title_fullStr Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title_full_unstemmed Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title_short Clustering Error Messages Produced by Distributed Computing Infrastructure During the Processing of High Energy Physics Data
title_sort clustering error messages produced by distributed computing infrastructure during the processing of high energy physics data
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2742495
work_keys_str_mv AT theatlascollaboration clusteringerrormessagesproducedbydistributedcomputinginfrastructureduringtheprocessingofhighenergyphysicsdata