A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis

This paper describes the Dynamic On Demand Analysis Service (DODAS), an automated system that simplifies the process of provisioning, creating, managing and accessing a pool of heterogeneous computing and storage resources, by generating clusters to run batch systems thereby implementing the "B...

Descripción completa

Detalles Bibliográficos
Autores principales: Spiga, D, Antonacci, M, Boccali, T, Ceccanti, A, Ciangottini, D, Donvito, G, Duma, C, Salomoni, D
Lenguaje:eng
Publicado: 2018
Materias:
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1109/NSSMIC.2017.8533143
http://cds.cern.ch/record/2672110
_version_ 1780962536616624128
author Spiga, D
Antonacci, M
Boccali, T
Ceccanti, A
Ciangottini, D
Donvito, G
Duma, C
Salomoni, D
author_facet Spiga, D
Antonacci, M
Boccali, T
Ceccanti, A
Ciangottini, D
Donvito, G
Duma, C
Salomoni, D
author_sort Spiga, D
collection CERN
description This paper describes the Dynamic On Demand Analysis Service (DODAS), an automated system that simplifies the process of provisioning, creating, managing and accessing a pool of heterogeneous computing and storage resources, by generating clusters to run batch systems thereby implementing the "Batch System as a Service" paradigm. DODAS is built on several INDIGO-DataCloud services among which: the PaaS Orchestrator, the Infrastructure Manager, and the Identity and Access Manager are the most important. The paper describes also a successfully integration of DODAS with the computing infrastructure of the Compact Muon Solenoid (CMS) experiment installed at LHC.
id oai-inspirehep.net-1727684
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling oai-inspirehep.net-17276842019-09-30T06:29:59Zdoi:10.1109/NSSMIC.2017.8533143http://cds.cern.ch/record/2672110engSpiga, DAntonacci, MBoccali, TCeccanti, ACiangottini, DDonvito, GDuma, CSalomoni, DA container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysisComputing and ComputersThis paper describes the Dynamic On Demand Analysis Service (DODAS), an automated system that simplifies the process of provisioning, creating, managing and accessing a pool of heterogeneous computing and storage resources, by generating clusters to run batch systems thereby implementing the "Batch System as a Service" paradigm. DODAS is built on several INDIGO-DataCloud services among which: the PaaS Orchestrator, the Infrastructure Manager, and the Identity and Access Manager are the most important. The paper describes also a successfully integration of DODAS with the computing infrastructure of the Compact Muon Solenoid (CMS) experiment installed at LHC.oai:inspirehep.net:17276842018
spellingShingle Computing and Computers
Spiga, D
Antonacci, M
Boccali, T
Ceccanti, A
Ciangottini, D
Donvito, G
Duma, C
Salomoni, D
A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title_full A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title_fullStr A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title_full_unstemmed A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title_short A container-based solution to generate HTCondor Batch Systems on demand exploiting heterogeneous Clouds for data analysis
title_sort container-based solution to generate htcondor batch systems on demand exploiting heterogeneous clouds for data analysis
topic Computing and Computers
url https://dx.doi.org/10.1109/NSSMIC.2017.8533143
http://cds.cern.ch/record/2672110
work_keys_str_mv AT spigad acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT antonaccim acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT boccalit acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT ceccantia acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT ciangottinid acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT donvitog acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT dumac acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT salomonid acontainerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT spigad containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT antonaccim containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT boccalit containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT ceccantia containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT ciangottinid containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT donvitog containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT dumac containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis
AT salomonid containerbasedsolutiontogeneratehtcondorbatchsystemsondemandexploitingheterogeneouscloudsfordataanalysis

Ejemplares similares