Cargando…

Grid-Brick Event Processing Framework in GEPS

Experiments like ATLAS at LHC involve a scale of computing and data management that greatly exceeds the capability of existing systems, making it necessary to resort to Grid-based Parallel Event Processing Systems (GEPS). Traditional Grid systems concentrate the data in central data servers which ha...

Descripción completa

Detalles Bibliográficos
Autores principales: Amorim, A, Pedro, L, Fei, H, Almeida, N, Trezentos, P, Villate, J E
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/622183
_version_ 1780900421118722048
author Amorim, A
Pedro, L
Fei, H
Almeida, N
Trezentos, P
Villate, J E
author_facet Amorim, A
Pedro, L
Fei, H
Almeida, N
Trezentos, P
Villate, J E
author_sort Amorim, A
collection CERN
description Experiments like ATLAS at LHC involve a scale of computing and data management that greatly exceeds the capability of existing systems, making it necessary to resort to Grid-based Parallel Event Processing Systems (GEPS). Traditional Grid systems concentrate the data in central data servers which have to be accessed by many nodes each time an analysis or processing job starts. These systems require very powerful central data servers and make little use of the distributed disk space that is available in commodity computers. The Grid-Brick system, which is described in this paper, follows a different approach. The data storage is split among all grid nodes having each one a piece of the whole information. Users submit queries and the system will distribute the tasks through all the nodes and retrieve the result, merging them together in the Job Submit Server. The main advantage of using this system is the huge scalability it provides, while its biggest disadvantage appears in the case of failure of one of the nodes. A workaround for this problem involves data replication or backup.
id cern-622183
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6221832019-09-30T06:29:59Zhttp://cds.cern.ch/record/622183engAmorim, APedro, LFei, HAlmeida, NTrezentos, PVillate, J EGrid-Brick Event Processing Framework in GEPSComputing and ComputersExperiments like ATLAS at LHC involve a scale of computing and data management that greatly exceeds the capability of existing systems, making it necessary to resort to Grid-based Parallel Event Processing Systems (GEPS). Traditional Grid systems concentrate the data in central data servers which have to be accessed by many nodes each time an analysis or processing job starts. These systems require very powerful central data servers and make little use of the distributed disk space that is available in commodity computers. The Grid-Brick system, which is described in this paper, follows a different approach. The data storage is split among all grid nodes having each one a piece of the whole information. Users submit queries and the system will distribute the tasks through all the nodes and retrieve the result, merging them together in the Job Submit Server. The main advantage of using this system is the huge scalability it provides, while its biggest disadvantage appears in the case of failure of one of the nodes. A workaround for this problem involves data replication or backup.cs.DC/0306093oai:cds.cern.ch:6221832003-06-14
spellingShingle Computing and Computers
Amorim, A
Pedro, L
Fei, H
Almeida, N
Trezentos, P
Villate, J E
Grid-Brick Event Processing Framework in GEPS
title Grid-Brick Event Processing Framework in GEPS
title_full Grid-Brick Event Processing Framework in GEPS
title_fullStr Grid-Brick Event Processing Framework in GEPS
title_full_unstemmed Grid-Brick Event Processing Framework in GEPS
title_short Grid-Brick Event Processing Framework in GEPS
title_sort grid-brick event processing framework in geps
topic Computing and Computers
url http://cds.cern.ch/record/622183
work_keys_str_mv AT amorima gridbrickeventprocessingframeworkingeps
AT pedrol gridbrickeventprocessingframeworkingeps
AT feih gridbrickeventprocessingframeworkingeps
AT almeidan gridbrickeventprocessingframeworkingeps
AT trezentosp gridbrickeventprocessingframeworkingeps
AT villateje gridbrickeventprocessingframeworkingeps