Cargando…

Measuring total download speed from EOS by grid jobs

<!--HTML-->Root protocol is a standard way to access data from EOS in a grid environment. The performance of storage is crucial for the effective use of computing resources. One of the questions that could be asked by a person who sends jobs to the grid is the following: how many jobs may simu...

Descripción completa

Detalles Bibliográficos
Autor principal: Pelevanyuk, Igor
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:http://cds.cern.ch/record/2709403
_version_ 1780965056016547840
author Pelevanyuk, Igor
author_facet Pelevanyuk, Igor
author_sort Pelevanyuk, Igor
collection CERN
description <!--HTML-->Root protocol is a standard way to access data from EOS in a grid environment. The performance of storage is crucial for the effective use of computing resources. One of the questions that could be asked by a person who sends jobs to the grid is the following: how many jobs may simultaneously download data from storage and still be effective? In order to answer this question, a simple test was created in JINR. The idea is the following: send 100-200 jobs, wait until all of them are in the running state, initiate file download from EOS, estimate how much time did it take to download all the data in all jobs. It is a purely functional test that gives understanding about the real performance of a storage element. The tests were performed in JINR: EOS was used as a storage element, local CE was used to run jobs, DIRAC was used as a workload management system, DIRAC standard utilities were used to initiate transfers.
id cern-2709403
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27094032022-11-02T22:11:51Zhttp://cds.cern.ch/record/2709403engPelevanyuk, IgorMeasuring total download speed from EOS by grid jobsEOS workshopHEP Computing<!--HTML-->Root protocol is a standard way to access data from EOS in a grid environment. The performance of storage is crucial for the effective use of computing resources. One of the questions that could be asked by a person who sends jobs to the grid is the following: how many jobs may simultaneously download data from storage and still be effective? In order to answer this question, a simple test was created in JINR. The idea is the following: send 100-200 jobs, wait until all of them are in the running state, initiate file download from EOS, estimate how much time did it take to download all the data in all jobs. It is a purely functional test that gives understanding about the real performance of a storage element. The tests were performed in JINR: EOS was used as a storage element, local CE was used to run jobs, DIRAC was used as a workload management system, DIRAC standard utilities were used to initiate transfers.oai:cds.cern.ch:27094032020
spellingShingle HEP Computing
Pelevanyuk, Igor
Measuring total download speed from EOS by grid jobs
title Measuring total download speed from EOS by grid jobs
title_full Measuring total download speed from EOS by grid jobs
title_fullStr Measuring total download speed from EOS by grid jobs
title_full_unstemmed Measuring total download speed from EOS by grid jobs
title_short Measuring total download speed from EOS by grid jobs
title_sort measuring total download speed from eos by grid jobs
topic HEP Computing
url http://cds.cern.ch/record/2709403
work_keys_str_mv AT pelevanyukigor measuringtotaldownloadspeedfromeosbygridjobs
AT pelevanyukigor eosworkshop