Cargando…

A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment

Scientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based...

Descripción completa

Detalles Bibliográficos
Autores principales: Titov, Mikhail, Zaruba, Gergely, De, Kaushik, Klimentov, Alexei, Mashinistov, Ruslan
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:http://cds.cern.ch/record/2279946
_version_ 1780955493439635456
author Titov, Mikhail
Zaruba, Gergely
De, Kaushik
Klimentov, Alexei
Mashinistov, Ruslan
author_facet Titov, Mikhail
Zaruba, Gergely
De, Kaushik
Klimentov, Alexei
Mashinistov, Ruslan
author_sort Titov, Mikhail
collection CERN
description Scientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based on the data obtained. For scientific distributed computing systems with hundreds of petabytes of data and thousands of users it is important to keep track not just of how data is distributed in the system, but also of individual user's interests in the distributed data (reveal implicit interconnection between user and data objects). This however requires the collection and use of specific statistics such as correlations between data distribution, the mechanics of data distribution, and mainly user preferences. This work focuses on user activities (specifically, data usages) and interests in such a distributed computing system, namely PanDA (Production ANd Distributed Analysis system). PanDA is a high-performance workload management system originally designed to meet production and analyses requirements for a data-driven workload at the Large Hadron Collider Computing Grid for the ATLAS Experiment hosted at CERN (the European Organization for Nuclear Research). In this work we are going to investigate whether data collection that was gathered in the past in PanDA shows any trends indicating that users could have mutual interests that would be kept for the next data usages (i.e., data usage patterns), with using data mining techniques such as association analysis, sequential pattern mining, and basics of the recommender system approach. We will show that such common interests between users indeed exist and thus could be used to provide recommendations (in terms of the collaborative filtering) to help users with their data selection process.
id cern-2279946
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling cern-22799462019-09-30T06:29:59Zhttp://cds.cern.ch/record/2279946engTitov, MikhailZaruba, GergelyDe, KaushikKlimentov, AlexeiMashinistov, RuslanA study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS ExperimentParticle Physics - ExperimentScientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based on the data obtained. For scientific distributed computing systems with hundreds of petabytes of data and thousands of users it is important to keep track not just of how data is distributed in the system, but also of individual user's interests in the distributed data (reveal implicit interconnection between user and data objects). This however requires the collection and use of specific statistics such as correlations between data distribution, the mechanics of data distribution, and mainly user preferences. This work focuses on user activities (specifically, data usages) and interests in such a distributed computing system, namely PanDA (Production ANd Distributed Analysis system). PanDA is a high-performance workload management system originally designed to meet production and analyses requirements for a data-driven workload at the Large Hadron Collider Computing Grid for the ATLAS Experiment hosted at CERN (the European Organization for Nuclear Research). In this work we are going to investigate whether data collection that was gathered in the past in PanDA shows any trends indicating that users could have mutual interests that would be kept for the next data usages (i.e., data usage patterns), with using data mining techniques such as association analysis, sequential pattern mining, and basics of the recommender system approach. We will show that such common interests between users indeed exist and thus could be used to provide recommendations (in terms of the collaborative filtering) to help users with their data selection process.ATL-SOFT-SLIDE-2017-666oai:cds.cern.ch:22799462017-08-16
spellingShingle Particle Physics - Experiment
Titov, Mikhail
Zaruba, Gergely
De, Kaushik
Klimentov, Alexei
Mashinistov, Ruslan
A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title_full A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title_fullStr A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title_full_unstemmed A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title_short A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
title_sort study on the applicability of recommender systems for the production and distributed analysis system panda of the atlas experiment
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2279946
work_keys_str_mv AT titovmikhail astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT zarubagergely astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT dekaushik astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT klimentovalexei astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT mashinistovruslan astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT titovmikhail studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT zarubagergely studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT dekaushik studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT klimentovalexei studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment
AT mashinistovruslan studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment