Cargando…
A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment
Scientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2279946 |
_version_ | 1780955493439635456 |
---|---|
author | Titov, Mikhail Zaruba, Gergely De, Kaushik Klimentov, Alexei Mashinistov, Ruslan |
author_facet | Titov, Mikhail Zaruba, Gergely De, Kaushik Klimentov, Alexei Mashinistov, Ruslan |
author_sort | Titov, Mikhail |
collection | CERN |
description | Scientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based on the data obtained. For scientific distributed computing systems with hundreds of petabytes of data and thousands of users it is important to keep track not just of how data is distributed in the system, but also of individual user's interests in the distributed data (reveal implicit interconnection between user and data objects). This however requires the collection and use of specific statistics such as correlations between data distribution, the mechanics of data distribution, and mainly user preferences. This work focuses on user activities (specifically, data usages) and interests in such a distributed computing system, namely PanDA (Production ANd Distributed Analysis system). PanDA is a high-performance workload management system originally designed to meet production and analyses requirements for a data-driven workload at the Large Hadron Collider Computing Grid for the ATLAS Experiment hosted at CERN (the European Organization for Nuclear Research). In this work we are going to investigate whether data collection that was gathered in the past in PanDA shows any trends indicating that users could have mutual interests that would be kept for the next data usages (i.e., data usage patterns), with using data mining techniques such as association analysis, sequential pattern mining, and basics of the recommender system approach. We will show that such common interests between users indeed exist and thus could be used to provide recommendations (in terms of the collaborative filtering) to help users with their data selection process. |
id | cern-2279946 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | cern-22799462019-09-30T06:29:59Zhttp://cds.cern.ch/record/2279946engTitov, MikhailZaruba, GergelyDe, KaushikKlimentov, AlexeiMashinistov, RuslanA study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS ExperimentParticle Physics - ExperimentScientific computing has advanced in a way of how to deal with massive amounts of data, since the production capacities have increased significantly for the last decades. Most large science experiments require vast computing and data storage resources in order to provide results or predictions based on the data obtained. For scientific distributed computing systems with hundreds of petabytes of data and thousands of users it is important to keep track not just of how data is distributed in the system, but also of individual user's interests in the distributed data (reveal implicit interconnection between user and data objects). This however requires the collection and use of specific statistics such as correlations between data distribution, the mechanics of data distribution, and mainly user preferences. This work focuses on user activities (specifically, data usages) and interests in such a distributed computing system, namely PanDA (Production ANd Distributed Analysis system). PanDA is a high-performance workload management system originally designed to meet production and analyses requirements for a data-driven workload at the Large Hadron Collider Computing Grid for the ATLAS Experiment hosted at CERN (the European Organization for Nuclear Research). In this work we are going to investigate whether data collection that was gathered in the past in PanDA shows any trends indicating that users could have mutual interests that would be kept for the next data usages (i.e., data usage patterns), with using data mining techniques such as association analysis, sequential pattern mining, and basics of the recommender system approach. We will show that such common interests between users indeed exist and thus could be used to provide recommendations (in terms of the collaborative filtering) to help users with their data selection process.ATL-SOFT-SLIDE-2017-666oai:cds.cern.ch:22799462017-08-16 |
spellingShingle | Particle Physics - Experiment Titov, Mikhail Zaruba, Gergely De, Kaushik Klimentov, Alexei Mashinistov, Ruslan A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title | A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title_full | A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title_fullStr | A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title_full_unstemmed | A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title_short | A study on the applicability of Recommender Systems for the Production and Distributed Analysis system PanDA of the ATLAS Experiment |
title_sort | study on the applicability of recommender systems for the production and distributed analysis system panda of the atlas experiment |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2279946 |
work_keys_str_mv | AT titovmikhail astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT zarubagergely astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT dekaushik astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT klimentovalexei astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT mashinistovruslan astudyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT titovmikhail studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT zarubagergely studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT dekaushik studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT klimentovalexei studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment AT mashinistovruslan studyontheapplicabilityofrecommendersystemsfortheproductionanddistributedanalysissystempandaoftheatlasexperiment |